-- Logs begin at Wed 2022-08-31 10:11:05 UTC, end at Wed 2022-08-31 11:14:57 UTC. -- Aug 31 10:39:56.176841 dv-cinder-795785-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 10:39:56.185931 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:39:56 2022] *** Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: nodename: dv-cinder-795785-12-iscsi Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: machine: x86_64 Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: clock source: unix Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: pcre jit disabled Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: detected number of CPU cores: 4 Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: current working directory: / Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: your processes number limit is 47680 Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: your memory page size is 4096 bytes Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: detected max file descriptor number: 2048 Aug 31 10:39:56.188076 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: lock engine: pthread robust mutexes Aug 31 10:39:56.188775 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: thunder lock: enabled Aug 31 10:39:56.188775 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 10:39:56.188775 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:39:56.229454 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: Python main interpreter initialized at 0x55da5b6e99c0 Aug 31 10:39:56.229454 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: python threads support enabled Aug 31 10:39:56.229454 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: your server socket listen backlog is limited to 100 connections Aug 31 10:39:56.229454 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:39:56.229886 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:39:56.229966 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: *** Operational MODE: preforking *** Aug 31 10:39:56.230216 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:39:56.230216 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: spawned uWSGI master process (pid: 81471) Aug 31 10:39:56.230480 dv-cinder-795785-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 31 10:39:56.231273 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: spawned uWSGI worker 1 (pid: 81483, cores: 1) Aug 31 10:39:56.231365 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: spawned uWSGI worker 2 (pid: 81484, cores: 1) Aug 31 10:39:56.233832 dv-cinder-795785-12-iscsi devstack@keystone.service[81471]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:40:00.479120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:40:00.479120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: from cryptography.utils import int_from_bytes Aug 31 10:40:00.479974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:40:00.479974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: from cryptography.utils import int_from_bytes Aug 31 10:40:00.480999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:40:00.480999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: from cryptography.utils import int_from_bytes Aug 31 10:40:00.481519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:40:00.481519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: from cryptography.utils import int_from_bytes Aug 31 10:40:00.528799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:40:00.528974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:40:00.529160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] command line args: [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:40:00.529419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:40:00.529553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ================================================================================ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:40:00.529700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:40:00.529859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] admin_token = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.529952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:40:00.530079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] config_dir = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.530218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] command line args: [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:40:00.530298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.530386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:40:00.530468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] config_source = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.530540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ================================================================================ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:40:00.530609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] debug = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.530757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] admin_token = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.530891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.531095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] config_dir = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.531161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.531224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.531287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.531344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] config_source = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] debug = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_config_append = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_dir = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.532944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_config_append = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_dir = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.533923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.534940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.535958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] publish_errors = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.536921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] publish_errors = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] standard_threads = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.537948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] use_journal = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] standard_threads = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] use_json = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.538923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] use_stderr = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] use_syslog = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] use_journal = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.539895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.539983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] use_json = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.540109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.540189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] use_stderr = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.540309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] use_syslog = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.540396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.540536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:40:00.540625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.540786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.540873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.541975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.542917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.543892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.544995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.545947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.546956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.547982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.548999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.549919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.550974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.551947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.552866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.553943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.554944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.555902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.556931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.557953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.558981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.559883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.560889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.561933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562769 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.562991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.563931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.external = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.564936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.password = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.external = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] auth.token = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.565943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.password = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.token = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.566866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.567879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.568975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.569942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.570915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.571969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.572960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.573918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.574982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.575902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.576978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.577934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.578860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.579929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.580955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.581890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.582910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.583929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.584913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.585978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.586884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.587993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.588878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.589908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.590926 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.591925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.592911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.593837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.594937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.595950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596457 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.596974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.597993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] role.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.598114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.598314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] role.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.598438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.598561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.598681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.598812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] role.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] role.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.599890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.600889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.601507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.602964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.603966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.604951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.605980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.606990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.607995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.608986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.609941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610835 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.610959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.611875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.612888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.613906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.614927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.615918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:40:00.616781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:40:00.616781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:40:00.642553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.642756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.642863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.643000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.643118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.643278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.651263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.651840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.679508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.679737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.679860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.680066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.732529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.732683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.780699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.780875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.781033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.781114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.940068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.940276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.940496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.940711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.940908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.941158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.941291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.941431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.941634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.941837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.942036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.942230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.963996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.964949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.965037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.965143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.965222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.965285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.965356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.965442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.976305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.976608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.989219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.989354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.989560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.989694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.989832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.989921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:00.990946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81483) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:40:01.007174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.007348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:40:01.007660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.007786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.007864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:40:01.007948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:40:01.008150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.008275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.008353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:40:01.008415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.008628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.008756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.008832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.008894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.009372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.009626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.018342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.018612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.018877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.019005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.019101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.019176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.019400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.019680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.026086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.026613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.028929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.029205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.029465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.029590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.029831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.029957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.030900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.031944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.032313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.054607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.054889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.056051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.056327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.056453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.056610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.060780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.061060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.061184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.061319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.061422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.061718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.067945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.068072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.068202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.068285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.072107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.072273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.072369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.072582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.072710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.072857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.072943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.073125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.073261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.073399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.073651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.073941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.074202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.075103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.075395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.075679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.090977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.091233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.091365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.091550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.095049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.095441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.098251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.098513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.098639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.098779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.102692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.103085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.105760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.106176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.108953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.109239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.109365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.109503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.109583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.109803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.109946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.110085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.110209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.110320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.110595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.110975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.126089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.126369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.126634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.126757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.126905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.127005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.127128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.127417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.133685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.134200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.135231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.135854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.136746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.137016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.137369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.137640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.139659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.139940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.140267 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.140394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.140551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.140698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.140791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.140869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.141086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.141365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.152008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.152281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.152661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.152788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.152950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.153860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.154056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.154340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.169379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.169983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.172273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.172969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.175131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.175834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.176557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.177268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.178197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.178468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.178746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.178872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.179069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.179264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.185074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.185697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.186556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.187170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.189506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.189803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.190101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.190226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.190363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.190455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.190672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.190947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.198212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.198497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.198770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.198907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.199043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.199334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.205545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81483) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.205806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.206116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.206239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:40:01.206375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.206570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.206703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.206797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.206863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.207100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.207228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.207414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.207598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.207703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.207839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.208984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.209111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81483) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.209238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.209238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.209478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.209802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:40:01.242502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da5b6e99c0 pid: 81483 (default app) Aug 31 10:40:01.243265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da5b6e99c0 pid: 81484 (default app) Aug 31 10:40:01.245798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645d92f-5ce7-4e2f-8fd1-62344aa7ba55 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.246094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645d92f-5ce7-4e2f-8fd1-62344aa7ba55 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.246361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645d92f-5ce7-4e2f-8fd1-62344aa7ba55 None None] PATH_INFO: `/v3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.251499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Wed Aug 31 10:40:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.890080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.890567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.890678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.897297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:07.903819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.904369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.904369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.977536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: INFO dbcounter [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] Registered counter for database keystone Aug 31 10:40:07.998650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG oslo_db.sqlalchemy.engines [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:40:08.009614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writer thread running {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:40:08.201713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG passlib.handlers.bcrypt [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81483) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:40:08.202133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG passlib.handlers.bcrypt [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81483) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:40:08.261144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:08.262888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:08.402052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 10:40:08.910663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:08.983216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: INFO dbcounter [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] Registered counter for database keystone Aug 31 10:40:09.007882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG oslo_db.sqlalchemy.engines [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:40:09.019282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writer thread running {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:40:09.139639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c535985-b09b-4189-8a6b-aa5b6d7393dc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.145049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.145673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.145980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.146246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.155395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.206626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:40:09.206961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba03fd-33b6-4a03-bdab-261cabf40508 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.217232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Aug 31 10:40:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:40:09.226459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.241818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a117b7-8224-4a0c-a01d-d3f30c6107f8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.246894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.248019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.248292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.248571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] PATH_INFO: `/v3/projects/5efb11cead144cc7a5078ee4532b8260` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.250262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] RBAC: Authorizing `identity:get_project(project_id=5efb11cead144cc7a5078ee4532b8260)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.303048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:40:09.303476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8c8be-373e-45c1-9255-9162fab00606 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.310062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/projects/5efb11cead144cc7a5078ee4532b8260 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:11.194812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207e60-7996-48fe-ab0c-20faeb8e4dce None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.195385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207e60-7996-48fe-ab0c-20faeb8e4dce None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.195385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207e60-7996-48fe-ab0c-20faeb8e4dce None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.199526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:11.205299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.205713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.205882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.229114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:11.230688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:11.240661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 10:40:11.505195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9207e60-7996-48fe-ab0c-20faeb8e4dce None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.526256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9207e60-7996-48fe-ab0c-20faeb8e4dce None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.531549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bfa8e-f7bc-4c4c-b745-4ba47479e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.532153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bfa8e-f7bc-4c4c-b745-4ba47479e078 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.532422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bfa8e-f7bc-4c4c-b745-4ba47479e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.532710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bfa8e-f7bc-4c4c-b745-4ba47479e078 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.545396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bfa8e-f7bc-4c4c-b745-4ba47479e078 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.547214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bfa8e-f7bc-4c4c-b745-4ba47479e078 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.556681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:40:11.562508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.572099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd348e-d967-48e4-a175-112a9c78a1f9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.578244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3e45-4ecf-486b-a125-291b48492dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.578861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3e45-4ecf-486b-a125-291b48492dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.579162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3e45-4ecf-486b-a125-291b48492dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.579420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3e45-4ecf-486b-a125-291b48492dc4 admin admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.580916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3e45-4ecf-486b-a125-291b48492dc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.582818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3e45-4ecf-486b-a125-291b48492dc4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.584364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:13.547683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2454-1c4d-4b51-b218-f7d0b6f304bc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.548252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2454-1c4d-4b51-b218-f7d0b6f304bc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.548252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2454-1c4d-4b51-b218-f7d0b6f304bc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.549557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:13.555047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.555497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.555631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.574359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:13.575549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:13.588753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379dd77-51cd-457e-808d-5edae456cf04 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.589036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379dd77-51cd-457e-808d-5edae456cf04 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.589313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379dd77-51cd-457e-808d-5edae456cf04 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.590666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 6/11] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:13.596759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.597127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.597502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.648433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG passlib.handlers.bcrypt [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81484) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:40:13.648903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG passlib.handlers.bcrypt [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81484) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:40:13.669415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:13.698579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:13.700411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:13.810693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:13.932956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.957600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.042586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff422ac-a386-417f-bd48-ffaa235e6985 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.076267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.076459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.076842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.077116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.077386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.089157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:14.097755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:14.098714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:14.099607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 7/14] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:14.104653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.187140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb526c4-e08a-4dae-90ca-d6e1d97bb34c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.189493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.190100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.209749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbcdde-932f-4892-a231-e75384ae3558 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.225880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.226741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.226992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.227267 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.243531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.244144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.244426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.244696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.245379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.245678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.247164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.259526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 8/15] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:14.265294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.296628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.298241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.364651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e79686-8f02-49ff-8ac7-fe11bc1df9d9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.395806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 8/16] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:14.401495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.403608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.404654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.404761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.404761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.404761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.406074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.407681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.409263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 9/17] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:14.414772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.429943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.500348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060d401-7499-437e-ac34-1ffe70744ae0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.513695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0688-a106-44f5-b2bf-e598427421e9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.533509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.534444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.534695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.534966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.548593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.549226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.549500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.549787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.550944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.552425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.553653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.554110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 10/18] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:14.555152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.559924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:14.573380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:14.574318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:14.575100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:14.575100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:14.575100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:14.575100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 9/19] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:14.581956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.638182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.645898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.665808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b0a7-92dd-44fc-9ec4-b0831eb86624 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.683533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81363a6-99b4-4a6f-84eb-47803d8f138f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.699895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.700723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.700723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.701050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.701746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.domain.id=default, user.id=bd54da1432894173a79d520df35ac9c0) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.702104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.703601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddfae9-b720-4ef4-9dcc-551cb813a633 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.710353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 11/20] 10.222.0.75 () {56 vars in 1322 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/role_assignments?user.id=bd54da1432894173a79d520df35ac9c0&scope.domain.id=default&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:14.717548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.718232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.718514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.718793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.719469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.719775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.721227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc9686-bf17-4a91-bd5c-bb9a669b285a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.741268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 10/21] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:16.718007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850df6d-af53-4cae-ba44-e447b8cb9c21 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.718576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850df6d-af53-4cae-ba44-e447b8cb9c21 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.718576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850df6d-af53-4cae-ba44-e447b8cb9c21 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.720131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 12/22] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:16.735931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcaf5-e9e8-4809-af69-5094efe92089 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.736461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcaf5-e9e8-4809-af69-5094efe92089 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.736461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcaf5-e9e8-4809-af69-5094efe92089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.760897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f3afcaf5-e9e8-4809-af69-5094efe92089 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:16.762161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f3afcaf5-e9e8-4809-af69-5094efe92089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:16.852461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 11/23] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:16.956043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8ef6-e8d0-47dd-a9d6-146b68d93bb8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.956637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8ef6-e8d0-47dd-a9d6-146b68d93bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.957086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8ef6-e8d0-47dd-a9d6-146b68d93bb8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.958923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:16.964766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ce8a-e2c7-43b4-9923-656c5ec3da37 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.965258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ce8a-e2c7-43b4-9923-656c5ec3da37 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.965724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ce8a-e2c7-43b4-9923-656c5ec3da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.994938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bac0ce8a-e2c7-43b4-9923-656c5ec3da37 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:16.996453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bac0ce8a-e2c7-43b4-9923-656c5ec3da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:17.050672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.087602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 12/25] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:17.211358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8ef6-e8d0-47dd-a9d6-146b68d93bb8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.335970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8ef6-e8d0-47dd-a9d6-146b68d93bb8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.383299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.383943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.384223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.384520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.399244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:17.404495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:17.405325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:17.406073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 14/26] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:17.410701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb5cd-3635-4f0c-9793-b088d7d3a727 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.410997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb5cd-3635-4f0c-9793-b088d7d3a727 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.411273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb5cd-3635-4f0c-9793-b088d7d3a727 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.412925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:17.413911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.418201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.418483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.418754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.447898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.448180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:17.451548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:17.553146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 14/28] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:17.601726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2820574-70ff-4aea-ae48-ae2bbe1d6c77 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.646826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.647451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.647728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.648000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.648662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:17.648964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.650448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.665584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 15/29] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:17.671779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.673214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.799344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.820216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf40e3-d9d5-4f84-a925-c9c2fe558da2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.834170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.851972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd06fc-c0b9-4bad-80e2-c0ee5f54638e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.886137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a2d1-0e33-471f-b8ff-e9a061df4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.886845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a2d1-0e33-471f-b8ff-e9a061df4517 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.887130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a2d1-0e33-471f-b8ff-e9a061df4517 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.887250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.887542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a2d1-0e33-471f-b8ff-e9a061df4517 None admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.887987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.888430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.888844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.891963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91a2d1-0e33-471f-b8ff-e9a061df4517 None admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.894768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91a2d1-0e33-471f-b8ff-e9a061df4517 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.901014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 15/30] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:17.902480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863fdd-74ec-4292-91ac-eec5a022c25b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.904659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863fdd-74ec-4292-91ac-eec5a022c25b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.904942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863fdd-74ec-4292-91ac-eec5a022c25b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.906332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 16/31] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:17.907046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863fdd-74ec-4292-91ac-eec5a022c25b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.907317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.909021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:17.926716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:17.927605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:17.928378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:17.928378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:17.928378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:17.928378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 16/32] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:17.929272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.037826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94a24a-1180-43c3-baba-5981cd51dbab None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.041198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863fdd-74ec-4292-91ac-eec5a022c25b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.056139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.074115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956876e7-1db9-4dcf-a176-08936c790691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.075063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956876e7-1db9-4dcf-a176-08936c790691 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.075512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956876e7-1db9-4dcf-a176-08936c790691 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.075915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956876e7-1db9-4dcf-a176-08936c790691 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.077177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956876e7-1db9-4dcf-a176-08936c790691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.078874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956876e7-1db9-4dcf-a176-08936c790691 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.080263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.080498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 17/33] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:18.081293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.081606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.081912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.082185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.082456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.082906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.083759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.085380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.100963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:18.102476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:18.180252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 18/34] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:18.181597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.237266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 17/35] 10.222.0.75 () {60 vars in 1131 bytes} [Wed Aug 31 10:40:17 2022] POST /identity/v3/roles => generated 219 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:18.245813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.321629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.325855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d52d07-d1f4-4e21-adcf-3bc0dd14b6ed None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.354318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.370787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.371844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.372305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.372773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.373646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:18.374181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.376492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1837d2-6789-486b-aaf6-d8caa6a11f98 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.406961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 19/36] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:18.409486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714e9d-0d1d-4a12-95aa-262b247e35c3 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.415313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714e9d-0d1d-4a12-95aa-262b247e35c3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.415955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714e9d-0d1d-4a12-95aa-262b247e35c3 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.418015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 20/37] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:18.420699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714e9d-0d1d-4a12-95aa-262b247e35c3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.485176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ccf30-b5a8-4460-bcae-028a8cb00357 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.527100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d341b6-7d54-4ff8-a706-21ce930a6f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.527835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d341b6-7d54-4ff8-a706-21ce930a6f73 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.528113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d341b6-7d54-4ff8-a706-21ce930a6f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.528384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d341b6-7d54-4ff8-a706-21ce930a6f73 None admin] PATH_INFO: `/v3/domains/default/users/bd54da1432894173a79d520df35ac9c0/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.531542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d341b6-7d54-4ff8-a706-21ce930a6f73 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bd54da1432894173a79d520df35ac9c0, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.532325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d341b6-7d54-4ff8-a706-21ce930a6f73 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.555680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 18/38] 10.222.0.75 () {58 vars in 1361 bytes} [Wed Aug 31 10:40:18 2022] PUT /identity/v3/domains/default/users/bd54da1432894173a79d520df35ac9c0/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:18.556203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714e9d-0d1d-4a12-95aa-262b247e35c3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.557476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.557761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.558054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.585392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:18.587598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:18.606225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e942b-f7c3-430e-bcb7-4bddcb70a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.606749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e942b-f7c3-430e-bcb7-4bddcb70a516 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.607028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e942b-f7c3-430e-bcb7-4bddcb70a516 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.607305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e942b-f7c3-430e-bcb7-4bddcb70a516 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.607961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e942b-f7c3-430e-bcb7-4bddcb70a516 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.609545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e942b-f7c3-430e-bcb7-4bddcb70a516 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.677199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 19/39] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:18.678571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.713680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.787713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b2b37-366d-41e5-b267-fb77135ac6a5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.795010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:18 2022] POST /identity/v3/projects => generated 301 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:18.828819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790dca4-21f0-41bf-8fa6-9ebe3e36ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.831804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790dca4-21f0-41bf-8fa6-9ebe3e36ca92 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.832213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790dca4-21f0-41bf-8fa6-9ebe3e36ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.832490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790dca4-21f0-41bf-8fa6-9ebe3e36ca92 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.833203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790dca4-21f0-41bf-8fa6-9ebe3e36ca92 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.834789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790dca4-21f0-41bf-8fa6-9ebe3e36ca92 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.859569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1131 bytes} [Wed Aug 31 10:40:18 2022] POST /identity/v3/roles => generated 225 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:18.907086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a4d9-8701-456a-aa35-478d5aede3e1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.907627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a4d9-8701-456a-aa35-478d5aede3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.907627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a4d9-8701-456a-aa35-478d5aede3e1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.909098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 22/42] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:18.914933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.915231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.915500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.948822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:18.950198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:19.026549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a4d9-8701-456a-aa35-478d5aede3e1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.032844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 21/43] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:19.062512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.147451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a4d9-8701-456a-aa35-478d5aede3e1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.186286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.186939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.187219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.187493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.188174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.189738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.211176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1131 bytes} [Wed Aug 31 10:40:19 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:40:19.328896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.346979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.437634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beac26a-473c-42ff-baf4-87c39ecad386 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.470169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab670a1-d40b-4758-86db-961286a92e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.470806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab670a1-d40b-4758-86db-961286a92e9b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.471085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab670a1-d40b-4758-86db-961286a92e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.471358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab670a1-d40b-4758-86db-961286a92e9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.472463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab670a1-d40b-4758-86db-961286a92e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.473977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab670a1-d40b-4758-86db-961286a92e9b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.475557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 22/45] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.481539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.682420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.695865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355bad-3d42-485e-993e-325d3e68e914 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.730166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7164003-3135-480c-9ce6-ac972582276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.730775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7164003-3135-480c-9ce6-ac972582276e None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.731049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7164003-3135-480c-9ce6-ac972582276e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.731322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7164003-3135-480c-9ce6-ac972582276e None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.731948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7164003-3135-480c-9ce6-ac972582276e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.733418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7164003-3135-480c-9ce6-ac972582276e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.762109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:19 2022] POST /identity/v3/projects => generated 312 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:20.640745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918df2-5e2f-48b4-968f-5fb4e0bedf3c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.641288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918df2-5e2f-48b4-968f-5fb4e0bedf3c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.641288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918df2-5e2f-48b4-968f-5fb4e0bedf3c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.642685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 23/47] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:20.648097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.648503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.648721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.672021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:20.673566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:20.753316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 25/48] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:21.022257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918df2-5e2f-48b4-968f-5fb4e0bedf3c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.111225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.132075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918df2-5e2f-48b4-968f-5fb4e0bedf3c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.167415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.168029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.168624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.168894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.180430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:21.186894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:21.187700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:21.188433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 24/49] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:21.194247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.266562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.300570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98ae3a-d0e8-4f4a-aa65-63645e859562 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.339518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.340161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.340443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.340720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.341393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.341696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.343161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.352160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 26/50] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.358234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.463482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf119fb6-12e8-4e8a-9eb9-b530bbdf4220 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.498283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.498909 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.499191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.499462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.500619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.502135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.503769 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 25/51] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.509560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.610950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5cc2-c0b9-4b85-8acb-b88719904891 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.641401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.647110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eadf33-79ef-4cb4-a47d-602859baae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.647762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eadf33-79ef-4cb4-a47d-602859baae1f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.648054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eadf33-79ef-4cb4-a47d-602859baae1f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.648332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eadf33-79ef-4cb4-a47d-602859baae1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.649473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eadf33-79ef-4cb4-a47d-602859baae1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.651032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eadf33-79ef-4cb4-a47d-602859baae1f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.652644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 27/52] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.658633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.665539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f799a6-b342-4969-b2af-8bedc1c8e0f8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.665847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f799a6-b342-4969-b2af-8bedc1c8e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.666110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f799a6-b342-4969-b2af-8bedc1c8e0f8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.667626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 28/53] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:21.672631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.672743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.672947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.673380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.691497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:21.692863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:21.761064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8755-fb7f-4a9c-b872-7ea5bafc10a2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.761415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 29/54] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:21.796960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.797583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.797889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.798147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.798880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.domain.id=default, user.id=bd54da1432894173a79d520df35ac9c0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.799189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.800662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.808955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 26/55] 10.222.0.75 () {56 vars in 1322 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/role_assignments?user.id=bd54da1432894173a79d520df35ac9c0&scope.domain.id=default&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:22.031669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.135715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377651c-a6b4-47fc-ac02-5f22baf03d92 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.164836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.171783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad10b-51f6-4520-947b-8a71b4da0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.172417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad10b-51f6-4520-947b-8a71b4da0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.172701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad10b-51f6-4520-947b-8a71b4da0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.172975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad10b-51f6-4520-947b-8a71b4da0ac2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.174119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad10b-51f6-4520-947b-8a71b4da0ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.175588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad10b-51f6-4520-947b-8a71b4da0ac2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.177133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 30/56] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:22.183102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.272353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.317464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e813c0-fc0d-459f-9fb3-033ac9edde00 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.355013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4abae-955b-473e-bb97-5e760a974aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.355636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4abae-955b-473e-bb97-5e760a974aa9 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.355910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4abae-955b-473e-bb97-5e760a974aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.356178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4abae-955b-473e-bb97-5e760a974aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.356819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4abae-955b-473e-bb97-5e760a974aa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.358317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4abae-955b-473e-bb97-5e760a974aa9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.502323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 27/57] 10.222.0.75 () {60 vars in 1140 bytes} [Wed Aug 31 10:40:22 2022] POST /identity/v3/projects => generated 298 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:24.436436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7147a-ebdd-4a88-8d80-1ebcb539073d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.437323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7147a-ebdd-4a88-8d80-1ebcb539073d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.437323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7147a-ebdd-4a88-8d80-1ebcb539073d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.439578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 31/58] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:24.446084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.446765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.446956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.467528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:24.468728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:24.538448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 28/59] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:24.811946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7147a-ebdd-4a88-8d80-1ebcb539073d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:24.929066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7147a-ebdd-4a88-8d80-1ebcb539073d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.974377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb0cc-72f6-4661-baa3-4c63675e0c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.975009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb0cc-72f6-4661-baa3-4c63675e0c29 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.975285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb0cc-72f6-4661-baa3-4c63675e0c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.975556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb0cc-72f6-4661-baa3-4c63675e0c29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.976764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abb0cc-72f6-4661-baa3-4c63675e0c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.978256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abb0cc-72f6-4661-baa3-4c63675e0c29 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.979830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 32/60] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:24.985552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.044104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.093000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65dd16-3e8f-4328-846c-f02992683aa1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.128343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94b94-9f33-4464-8beb-68936cf0d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.129240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94b94-9f33-4464-8beb-68936cf0d594 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.129626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94b94-9f33-4464-8beb-68936cf0d594 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.130052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94b94-9f33-4464-8beb-68936cf0d594 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.131067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff94b94-9f33-4464-8beb-68936cf0d594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.133402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff94b94-9f33-4464-8beb-68936cf0d594 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.167207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 29/61] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:24 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:28.085097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc0a2-afb6-409e-843f-ddf269231fd1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.085969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc0a2-afb6-409e-843f-ddf269231fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.086395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc0a2-afb6-409e-843f-ddf269231fd1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.088172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 33/62] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:28.093876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c6bf-645d-4814-9f5f-e5c55eca66ed None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.094611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c6bf-645d-4814-9f5f-e5c55eca66ed None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.095030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c6bf-645d-4814-9f5f-e5c55eca66ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.118919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a838c6bf-645d-4814-9f5f-e5c55eca66ed None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:28.120042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a838c6bf-645d-4814-9f5f-e5c55eca66ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:28.212703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 30/63] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:28.229799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb747a-e9b6-4fa1-be8d-9c9ed8576fb9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.230082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb747a-e9b6-4fa1-be8d-9c9ed8576fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.230360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb747a-e9b6-4fa1-be8d-9c9ed8576fb9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.231907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 34/64] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:28.237200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8878e9-0c1c-41aa-8489-c29cf34052bf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.237491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8878e9-0c1c-41aa-8489-c29cf34052bf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.237794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8878e9-0c1c-41aa-8489-c29cf34052bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.263290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3f8878e9-0c1c-41aa-8489-c29cf34052bf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:28.264468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3f8878e9-0c1c-41aa-8489-c29cf34052bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:28.312127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.348392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 31/65] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:28.502369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ba9a-951f-4ab6-b30a-4077bb1e4ec5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.503039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ba9a-951f-4ab6-b30a-4077bb1e4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.503515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ba9a-951f-4ab6-b30a-4077bb1e4ec5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.505095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 35/66] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:28.510521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadbb9e-fc1b-416d-b8fb-fe4bd1ef1982 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.511076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadbb9e-fc1b-416d-b8fb-fe4bd1ef1982 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.511550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadbb9e-fc1b-416d-b8fb-fe4bd1ef1982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.538161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4aadbb9e-fc1b-416d-b8fb-fe4bd1ef1982 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:28.539729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4aadbb9e-fc1b-416d-b8fb-fe4bd1ef1982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:28.564925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490ba9a-951f-4ab6-b30a-4077bb1e4ec5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.633821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 32/67] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:28.688287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.735801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490ba9a-951f-4ab6-b30a-4077bb1e4ec5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.772723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e8ee-6c62-45e3-b1f2-9dc4b787a646 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.773017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e8ee-6c62-45e3-b1f2-9dc4b787a646 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.773198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e8ee-6c62-45e3-b1f2-9dc4b787a646 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.774551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 33/68] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:28.779736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.780017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.780289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.795132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:28.795791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.796068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.796339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.802445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:28.803991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:28.809496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:28.815220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:28.816047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:28.816801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 36/69] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:28.817403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.894641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 34/70] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:28.895583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.937462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.938106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1919f-bf3f-4015-ba68-9f281414e7a7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.964757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.978394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50157f-39cc-40a5-a193-a0b28cd17ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:28.979047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50157f-39cc-40a5-a193-a0b28cd17ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.979340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50157f-39cc-40a5-a193-a0b28cd17ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.979615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50157f-39cc-40a5-a193-a0b28cd17ab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.991119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50157f-39cc-40a5-a193-a0b28cd17ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4f50157f-39cc-40a5-a193-a0b28cd17ab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:28.996058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:28.996896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:28.997638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 37/71] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:28.998737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9a98-f017-4119-addf-0570b741260b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.998737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9a98-f017-4119-addf-0570b741260b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.999401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9a98-f017-4119-addf-0570b741260b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.000656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 38/72] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:29.005407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9a98-f017-4119-addf-0570b741260b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.015906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db564c-769b-48a0-b610-391f69bc3f89 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.050474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.051019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.051294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.051560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.052224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:29.052521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.053950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.065580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 35/73] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.066303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.122188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9a98-f017-4119-addf-0570b741260b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.159011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.160332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6febad-7a76-4b36-bad0-6a15b21e9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.161327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6febad-7a76-4b36-bad0-6a15b21e9435 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.161880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6febad-7a76-4b36-bad0-6a15b21e9435 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.162447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6febad-7a76-4b36-bad0-6a15b21e9435 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.166347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5c59-ece3-49a1-8010-078b1de909b5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.173458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6febad-7a76-4b36-bad0-6a15b21e9435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ff6febad-7a76-4b36-bad0-6a15b21e9435 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:29.178381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:29.179192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:29.179927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 39/74] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:29.181105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.181105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.181323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.200131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:29.201442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:29.203136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.203753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.204020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.204291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.204971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:29.205274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.206691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.214796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 36/75] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.218379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.245178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.271156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 40/76] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:29.272002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.330464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864456e1-ecae-4dfc-906d-81375bcf78a9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.368118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.369082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.369365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.369640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.370896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.372369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.374026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 37/77] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.374750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.385109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e665-2411-48ce-b17d-b7388b575f70 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.400694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.420577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.421212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.421490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.421763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.434225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:29.439070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:29.439915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 41/78] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:29.442634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.482905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.488500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad38e1-1180-4179-a61c-6599b07905be None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.525111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.525751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.526077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.526361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.527070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:29.527372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.528777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.537193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 38/79] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.538132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.554620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188c48-7d7a-4895-ac51-585dc5c172ca None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.586682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.587248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.587524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.587798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.600710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.602200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.603806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 42/80] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.604563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.626961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.642437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e49ed-18cd-4e69-a6ec-6b0baa0d25c1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.676494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.677104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.677388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.677665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.698054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.705356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ecc9c-bc94-46d7-be5d-9d353e8a4a12 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.739108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.739736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.740054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.740435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.740941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:29.741244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.742670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.743877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.745325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.751128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 43/81] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.752136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.830278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.846439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 39/82] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:29.847979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.854551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a6aea-7085-4d9d-a469-9e1cbf309256 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.888077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.888715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.888998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.889277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.890432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.891946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.893882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 44/83] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.899184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.923640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.945485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703908-ea1b-43c2-a1dd-7960887ad464 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.978117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.978751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.979024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.979293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.980456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.981953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.983554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 40/84] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.988301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.998748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556834a-516f-43db-ac2d-bea86397adbb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.032540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.033129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.033411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.033689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.042771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.088708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbc734-f10e-4b81-8242-1fe375acd4b4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.100247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.101695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.122552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.123183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.123465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.123747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.124818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.125280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.126795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.128468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 41/85] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.129236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.199771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 45/86] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:30.200622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.228831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361048f-94bf-4a8f-b3ed-99a90f329d59 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.251607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.264103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.264737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.265014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.265286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.266426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.267886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.269581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 42/87] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.270362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.297867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cb625-e77c-4a3d-81e1-c7a43a78b9eb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.321996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.333036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.333653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.333964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.334240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.334891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.336365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.363750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 46/88] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:30 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:30.367081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.368826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690767c3-4dbe-4656-af8a-98d0e4d2fed7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.411203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.411807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.412097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.412410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.475593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.486565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647fb75-142d-4a1a-9821-9738180737dc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.487772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.489384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.530744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.532251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.532251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.532251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.590259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.605834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 43/89] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:30.605834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.620080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.621636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.714595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.725992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef7000-2afe-496d-9be3-1dfa6343dbb3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.753605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 47/90] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:30.754563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.770590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.771232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.771800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.771800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.772962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.774451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.776112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 44/91] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.776891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.848880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.870724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae066a5-d426-4093-b1fc-64d8f2a33c80 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.894867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7dfc-b32e-400c-8470-d87790501933 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.906896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.907959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.908424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.908898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.909852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=248b025f240a476dadac1c918e685632, user.id=bd54da1432894173a79d520df35ac9c0) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.910345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.912121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.925880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 48/92] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/role_assignments?user.id=bd54da1432894173a79d520df35ac9c0&scope.project.id=248b025f240a476dadac1c918e685632&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.927231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.933957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.935215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.935496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.935770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.937029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.939429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.940294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 45/93] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.941085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.976869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.075730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79456bed-be7a-4578-b795-bc8fd152b303 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.108074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8d4d-55ba-4394-8952-514d69f90355 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.113510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.114557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.115089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.115706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] PATH_INFO: `/v3/projects/f1c66e8a220b49559322e6b65712bf3c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.117102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] RBAC: Authorizing `identity:get_project(project_id=f1c66e8a220b49559322e6b65712bf3c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.118791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.120664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 49/94] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/projects/f1c66e8a220b49559322e6b65712bf3c => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:31.121757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.138145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.201802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.202442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.202722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.202995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.203741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=248b025f240a476dadac1c918e685632, user.id=cf9ab79962264150b479a8b5c3cbbfb0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:31.204048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.205569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.216136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 46/95] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/role_assignments?user.id=cf9ab79962264150b479a8b5c3cbbfb0&scope.project.id=248b025f240a476dadac1c918e685632&role.id=8d8fadd4e1414e3da426c068de39430b => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:31.217011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.233128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eac9fd-a225-42f1-af24-93a452493b04 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.270889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.271965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.272459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.272918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.273930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] RBAC: Adding query filter params (role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=248b025f240a476dadac1c918e685632, user.id=cf9ab79962264150b479a8b5c3cbbfb0) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:31.274458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.276186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7a8f7-3440-4d06-8962-941683c54622 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.282787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 50/96] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/role_assignments?user.id=cf9ab79962264150b479a8b5c3cbbfb0&scope.project.id=248b025f240a476dadac1c918e685632&role.id=82cfaa1d7baa4067892940a470beb46e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:31.385883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.401948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c4f10-23d1-4324-b1f0-1f21b53f71ce None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.456845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.457864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.458354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.458865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.459947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=f1c66e8a220b49559322e6b65712bf3c, user.id=cf9ab79962264150b479a8b5c3cbbfb0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:31.460444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.462317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5e9c-525e-47c0-b97a-76031ae15487 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.474709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 47/97] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/role_assignments?user.id=cf9ab79962264150b479a8b5c3cbbfb0&scope.project.id=f1c66e8a220b49559322e6b65712bf3c&role.id=8d8fadd4e1414e3da426c068de39430b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:32.854875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065bd5-e11b-4fb4-962d-46f44478ae22 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.855317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065bd5-e11b-4fb4-962d-46f44478ae22 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.855576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065bd5-e11b-4fb4-962d-46f44478ae22 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.856849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 51/98] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:32.862038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e633-161b-4056-88ed-c97a8b93a639 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.862435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e633-161b-4056-88ed-c97a8b93a639 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.862600 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e633-161b-4056-88ed-c97a8b93a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.885237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-24a9e633-161b-4056-88ed-c97a8b93a639 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:32.889977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24a9e633-161b-4056-88ed-c97a8b93a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:32.973526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 48/99] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:33.060651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81565b38-10a5-41bc-a2af-eceee70073db None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.060973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81565b38-10a5-41bc-a2af-eceee70073db None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.061200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81565b38-10a5-41bc-a2af-eceee70073db None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.062612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 52/100] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:33.067733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.068020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.068299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.086473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:33.087644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:33.173643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 49/101] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:33.358729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81565b38-10a5-41bc-a2af-eceee70073db None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.434517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.451784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.457952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.506634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81565b38-10a5-41bc-a2af-eceee70073db None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.542019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816c80-f1e6-4584-80fb-76482df8a919 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.579972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.580621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.580897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.581229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.581531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.582422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.582981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.583443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.586502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.588012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.589635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 53/102] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:33.596133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:33.601091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:33.601930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:33.602669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:33.603249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 50/103] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:33.603779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.608737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.688632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.714367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628b72-c379-40d8-893f-54c218a40fe0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.748923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.749546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.749844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.750228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.750908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:33.751208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.752717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414c140-387d-46b8-853e-432a23e8210a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.761531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 51/104] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:33.767143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abdfdc-04bb-47f7-b575-5948d75dff95 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.767422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abdfdc-04bb-47f7-b575-5948d75dff95 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.767683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abdfdc-04bb-47f7-b575-5948d75dff95 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.769437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 52/105] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:33.774609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.774887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.775156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.784455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567d0c9-a889-4ba1-a6ab-31920a518af1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.794050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:33.795652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:33.854520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.855164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.855715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.855715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.856390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.857917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.869516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 53/106] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:33.870423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.889090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.919741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 54/107] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:33 2022] POST /identity/v3/projects => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:33.966261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.014698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70cc9-b9df-45e6-9964-18b5378d3e14 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.059618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31ff0-c0c1-43f2-968a-e3f07d75f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.060276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31ff0-c0c1-43f2-968a-e3f07d75f24e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.060556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31ff0-c0c1-43f2-968a-e3f07d75f24e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.060827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31ff0-c0c1-43f2-968a-e3f07d75f24e None admin] PATH_INFO: `/v3/users/eb2dd72fe0d7413bba37d3f3a49bbfa4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.077713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31ff0-c0c1-43f2-968a-e3f07d75f24e None admin] RBAC: Authorizing `identity:get_user(user_id=eb2dd72fe0d7413bba37d3f3a49bbfa4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.079241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31ff0-c0c1-43f2-968a-e3f07d75f24e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.080997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 54/108] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/users/eb2dd72fe0d7413bba37d3f3a49bbfa4 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.086773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.216900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6595-cb4b-4537-a228-02ea06dca9a8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.262510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.263577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.264070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.264529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.307441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b87a19-662d-4716-b9cf-8f315e06b2eb None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.307770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b87a19-662d-4716-b9cf-8f315e06b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.307993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b87a19-662d-4716-b9cf-8f315e06b2eb None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.309455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 55/109] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:34.322343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de813296-6b6c-438b-a5a9-60a308ad586b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.322620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de813296-6b6c-438b-a5a9-60a308ad586b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.322896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de813296-6b6c-438b-a5a9-60a308ad586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.342692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.350517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.352435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.358831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-de813296-6b6c-438b-a5a9-60a308ad586b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:34.360182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-de813296-6b6c-438b-a5a9-60a308ad586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:34.471340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 55/110] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:34.472122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.477967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 56/111] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:34.483293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e4936-5a0e-4195-831a-53a5ae384b69 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.483574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e4936-5a0e-4195-831a-53a5ae384b69 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.483849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e4936-5a0e-4195-831a-53a5ae384b69 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.485172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 57/112] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:34.485919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e4936-5a0e-4195-831a-53a5ae384b69 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.565553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.588150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.595763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2dee3-5859-481a-a306-a83c6310c2c4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.626281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e4936-5a0e-4195-831a-53a5ae384b69 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.639334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25df896-7104-4dca-8410-2e7103857069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.640116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25df896-7104-4dca-8410-2e7103857069 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.640538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25df896-7104-4dca-8410-2e7103857069 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.640901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25df896-7104-4dca-8410-2e7103857069 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.652246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25df896-7104-4dca-8410-2e7103857069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d25df896-7104-4dca-8410-2e7103857069 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:34.657499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:34.658527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:34.659449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:34.661033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 56/113] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:34.662973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.663394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.663698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.673070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcbad-afd6-4ee2-949a-54df53823dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.674015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcbad-afd6-4ee2-949a-54df53823dae None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.674444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcbad-afd6-4ee2-949a-54df53823dae None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.674846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcbad-afd6-4ee2-949a-54df53823dae None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.676099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcbad-afd6-4ee2-949a-54df53823dae None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.678306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcbad-afd6-4ee2-949a-54df53823dae None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.680427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 58/114] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.685803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e57874-34d3-4b86-842a-3e7264c96c31 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.687009 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e57874-34d3-4b86-842a-3e7264c96c31 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.687009 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e57874-34d3-4b86-842a-3e7264c96c31 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.687728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:34.688468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 59/115] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:34.688922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:34.689696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e57874-34d3-4b86-842a-3e7264c96c31 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.784636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 57/116] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:34.784636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.810640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e57874-34d3-4b86-842a-3e7264c96c31 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.841072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.860240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.861122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.861569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.862049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.862740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.863039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.864438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325c16-e638-4002-ae56-891430854d09 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.873031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 60/117] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.878946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.879235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.879505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.891658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.899387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:34.900587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:34.917087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb3ad-4256-4577-a750-1f581640df38 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.961713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.962887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.963759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.964496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.965733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] RBAC: Adding query filter params (role.id=cde012161d59480cb7d2d8bd7c10763e, scope.project.id=248b025f240a476dadac1c918e685632, user.id=eb2dd72fe0d7413bba37d3f3a49bbfa4) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.966769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.968986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.976336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 58/118] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/role_assignments?user.id=eb2dd72fe0d7413bba37d3f3a49bbfa4&scope.project.id=248b025f240a476dadac1c918e685632&role.id=cde012161d59480cb7d2d8bd7c10763e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.977481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.978132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 61/119] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:34.979082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.147992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777800bb-47a9-4f09-8c2a-74e33ce77e72 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.165192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3f534-ed74-489f-997e-42efe5fdf86b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.185190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.198081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.199349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.200304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.201060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.210567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.211223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.211508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.211837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.213053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.214622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.215358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:35.216525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 62/120] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.217142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:35.222236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:35.223108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:35.223851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:35.227753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 59/121] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:35.228790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.264632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.394058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b59563-1a0e-45f9-9bee-72a1cac277a5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.409007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6a404-902a-4940-b1c4-6e4f263f2843 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.432661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.433655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.434476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.434936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.445938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:35.449906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.450562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.450847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.451133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.452369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:35.453321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:35.454142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:35.454874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:35.455425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.455938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 60/122] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.458077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 63/123] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:35.463461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.463608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.521834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.559935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.580777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4d29-65d6-4b6a-8980-3cd2cd2981af None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.584940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232165a-26fc-4355-8ad2-28d90f932b5f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.614954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.615541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.615822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.616089 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.623307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.624273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.624795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.625251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.626119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:35.626514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:35.626804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.628376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:35.631389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:35.632204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:35.632945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 64/124] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:35.633561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.645430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 61/125] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.646569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.739650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f5832-bee1-4bc8-a694-db33ee5705ec None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.741321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.759489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87be24-a094-4cfd-a247-f888e6f4b2e3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.775087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.776054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.776310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.776701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632/users/cf9ab79962264150b479a8b5c3cbbfb0/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.779036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] RBAC: Authorizing `identity:create_grant(project_id=248b025f240a476dadac1c918e685632, user_id=cf9ab79962264150b479a8b5c3cbbfb0, role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.780589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.797977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 65/126] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:35 2022] PUT /identity/v3/projects/248b025f240a476dadac1c918e685632/users/cf9ab79962264150b479a8b5c3cbbfb0/roles/82cfaa1d7baa4067892940a470beb46e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:35.798763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.800829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.802024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.802504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.804056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.805050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:35.805668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.807333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.830486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 62/127] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.837232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.843699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.015848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76861-e28f-4f6a-b9d2-305bbb6726ab None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.032192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bacfce-44d0-4415-bb37-9e5bfa674d47 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.062012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.063093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.063975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.064359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.065389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:36.065784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.067933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.072495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.073459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.073994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.074470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.075881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.077566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.079428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 63/128] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.080411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.097821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 66/129] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.097821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.131243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.214107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24f81-4df6-4be5-bc57-de781fa1fcde None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.223499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.255812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.256453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.256758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.257051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.258374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.261816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.261816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 67/130] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.262574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.293720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2cda-0fb5-461a-b2ee-ed30284b0750 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.362677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.364858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.365511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.365904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.366188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.372561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc380-8c05-4d44-9e7e-38b86af670a7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.374619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.376154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.378040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 64/131] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.378631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.408469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dbdeb-95d6-4ac4-8975-0f5b47c2ab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.409119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbdeb-95d6-4ac4-8975-0f5b47c2ab1b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.409403 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbdeb-95d6-4ac4-8975-0f5b47c2ab1b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.409798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbdeb-95d6-4ac4-8975-0f5b47c2ab1b None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.410941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dbdeb-95d6-4ac4-8975-0f5b47c2ab1b None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.412581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dbdeb-95d6-4ac4-8975-0f5b47c2ab1b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.414443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 68/132] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.415754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9319b9-86fe-404b-98b2-dba8702ee969 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.416039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9319b9-86fe-404b-98b2-dba8702ee969 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.416413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9319b9-86fe-404b-98b2-dba8702ee969 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.417657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 69/133] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:36.418402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9319b9-86fe-404b-98b2-dba8702ee969 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.511103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549c47-385b-48dd-96f0-437bddfef827 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.541066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9319b9-86fe-404b-98b2-dba8702ee969 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.547488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.548436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.548909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.549422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632/users/cf9ab79962264150b479a8b5c3cbbfb0/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.551686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] RBAC: Authorizing `identity:create_grant(project_id=248b025f240a476dadac1c918e685632, user_id=cf9ab79962264150b479a8b5c3cbbfb0, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.553500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.568506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.576154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 65/134] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:36 2022] PUT /identity/v3/projects/248b025f240a476dadac1c918e685632/users/cf9ab79962264150b479a8b5c3cbbfb0/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:36.578331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.581017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507355d-eb69-4775-8973-8b1e1a3c6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.581683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507355d-eb69-4775-8973-8b1e1a3c6247 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.582183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507355d-eb69-4775-8973-8b1e1a3c6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.582423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507355d-eb69-4775-8973-8b1e1a3c6247 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.583561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507355d-eb69-4775-8973-8b1e1a3c6247 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.585132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507355d-eb69-4775-8973-8b1e1a3c6247 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.587445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 70/135] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.588847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.589143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.589417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.608801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:36.610554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:36.638060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.704815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 71/136] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:36.706466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.741083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa6a7-610f-4358-aefb-8a3526c41384 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.805285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.805996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.806283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.806572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] PATH_INFO: `/v3/projects/f1c66e8a220b49559322e6b65712bf3c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.807785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] RBAC: Authorizing `identity:get_project(project_id=f1c66e8a220b49559322e6b65712bf3c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.810164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.812064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 66/137] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/projects/f1c66e8a220b49559322e6b65712bf3c => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.817986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.916733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e23e1a-9447-441e-8385-0c5c53e70c63 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.929127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.990240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.990987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.991452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.991728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632/users/bd54da1432894173a79d520df35ac9c0/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.999369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=248b025f240a476dadac1c918e685632, user_id=bd54da1432894173a79d520df35ac9c0, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.000918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.021911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690f9bf-b116-453c-9a70-1f3cab63aa2a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.025569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 72/138] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:36 2022] PUT /identity/v3/projects/248b025f240a476dadac1c918e685632/users/bd54da1432894173a79d520df35ac9c0/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:37.070996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.089395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.090135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.090511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.090811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] PATH_INFO: `/v3/projects/f1c66e8a220b49559322e6b65712bf3c/users/cf9ab79962264150b479a8b5c3cbbfb0/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.092915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1c66e8a220b49559322e6b65712bf3c, user_id=cf9ab79962264150b479a8b5c3cbbfb0, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.094455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.104980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.128821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 67/139] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:36 2022] PUT /identity/v3/projects/f1c66e8a220b49559322e6b65712bf3c/users/cf9ab79962264150b479a8b5c3cbbfb0/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:40:37.252788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe35966-6226-44dd-ba1b-6daee1448b78 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.296016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf791a3-411f-4556-8015-0c5bf67658bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.296681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf791a3-411f-4556-8015-0c5bf67658bc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.296951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf791a3-411f-4556-8015-0c5bf67658bc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.297217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf791a3-411f-4556-8015-0c5bf67658bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.300097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf791a3-411f-4556-8015-0c5bf67658bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.301601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf791a3-411f-4556-8015-0c5bf67658bc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.303292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 73/140] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:37.309362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.410803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207f38-7d7d-44df-8a31-846e672ccbe4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.411098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207f38-7d7d-44df-8a31-846e672ccbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.411289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207f38-7d7d-44df-8a31-846e672ccbe4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.412697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 74/141] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:37.418241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.418725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.419093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.430566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df99af-1d19-4d71-9c6d-5820d8cd6655 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.440825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:37.441591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:37.465358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.479920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.481180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.482189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.482608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.483664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.486141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.518302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 68/142] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:37 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:40:37.540799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 75/143] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:37.974177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.084683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc10c-3ffc-47bc-975c-d554165bb9e2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.126585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.127189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.127424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.127692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.140206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:38.145828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:38.146668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:38.147392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 69/144] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:38.153192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.173673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.271491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445c5e-3446-474f-acae-5a670fac9daf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.313183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.313844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.314133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.314393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.315078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:38.315370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.316790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69165e01-6cbb-4d44-a7e4-11fed2c9288d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.330138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 76/145] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:38.337372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.395859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.461317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f1f3a-9c94-4c8c-91f7-70907a13b276 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.500069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30ba58-0498-4fd9-bbe7-7bcbbb7a7723 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.500544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30ba58-0498-4fd9-bbe7-7bcbbb7a7723 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.500693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30ba58-0498-4fd9-bbe7-7bcbbb7a7723 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.501006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.501658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.501985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.502228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] PATH_INFO: `/v3/users/eb2dd72fe0d7413bba37d3f3a49bbfa4` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.502371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 77/146] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:38.508877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] RBAC: Authorizing `identity:get_user(user_id=eb2dd72fe0d7413bba37d3f3a49bbfa4)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.509627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.509945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.510215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.510425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.512262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 70/147] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/users/eb2dd72fe0d7413bba37d3f3a49bbfa4 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:38.517627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.547070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:38.548298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:38.680091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 78/148] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:38.686917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1fce6-13de-4413-a140-80425ff98489 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.704378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.748717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.749839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.750410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.750882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.757258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.759314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.761795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 71/149] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:38.767404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.783053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.882871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9898512-5192-4535-853e-80e6d39abda8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.918041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.918715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.919021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.919296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632/users/eb2dd72fe0d7413bba37d3f3a49bbfa4/roles/cde012161d59480cb7d2d8bd7c10763e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.921615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] RBAC: Authorizing `identity:create_grant(project_id=248b025f240a476dadac1c918e685632, user_id=eb2dd72fe0d7413bba37d3f3a49bbfa4, role_id=cde012161d59480cb7d2d8bd7c10763e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.923099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.938449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 79/150] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:38 2022] PUT /identity/v3/projects/248b025f240a476dadac1c918e685632/users/eb2dd72fe0d7413bba37d3f3a49bbfa4/roles/cde012161d59480cb7d2d8bd7c10763e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:39.211251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.326966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92876e55-a9e7-4ecf-9483-4759efe88497 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.373954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.374604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.374884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.375159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.390682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:39.396150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:39.396981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:39.397735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 72/151] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:39.404475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.492954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.528966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419a35-edfc-4ccd-87e5-a52ed69f4de2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.573164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.573862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.574142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.574459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.575173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:39.575476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.576870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.590015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 80/152] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:39.591160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.672410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.766606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097384c-a3fa-4939-8934-8dc61b02fcd5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.824390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c250e-44fb-4beb-8bab-09570d82a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.825042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c250e-44fb-4beb-8bab-09570d82a966 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.825379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c250e-44fb-4beb-8bab-09570d82a966 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.825654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c250e-44fb-4beb-8bab-09570d82a966 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.828832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c250e-44fb-4beb-8bab-09570d82a966 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.828832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c250e-44fb-4beb-8bab-09570d82a966 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.830130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 73/153] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:39.838400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.975611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f715c-ff47-426f-ae6d-bc2eaaccc89a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.009723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.012696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.013399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.013672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.013973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.084551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.085970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.155387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800704-4f68-4512-86fb-91ceb4dad85c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.155708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800704-4f68-4512-86fb-91ceb4dad85c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.155948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800704-4f68-4512-86fb-91ceb4dad85c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.157324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 74/154] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:40.163025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.163296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.163564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.192084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 81/155] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:40.199764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.214821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:40.216087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:40.238162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.333236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e42b9-3adc-4900-be14-4b2ec75b6077 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.390587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e441e-3723-4907-9b25-6fb04e8ba889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.391149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e441e-3723-4907-9b25-6fb04e8ba889 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.391426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e441e-3723-4907-9b25-6fb04e8ba889 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.391695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e441e-3723-4907-9b25-6fb04e8ba889 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.392859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e441e-3723-4907-9b25-6fb04e8ba889 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.394411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e441e-3723-4907-9b25-6fb04e8ba889 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.396476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 82/156] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:40.397639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c784-4efd-4f03-b01f-b4306799c99e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.397948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c784-4efd-4f03-b01f-b4306799c99e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.398217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c784-4efd-4f03-b01f-b4306799c99e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.404370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 83/157] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:40.405665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea9d8-4931-4a56-9fe9-f130d09b24f2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.406242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea9d8-4931-4a56-9fe9-f130d09b24f2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.406242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea9d8-4931-4a56-9fe9-f130d09b24f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.427510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 75/158] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:40.428426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.435186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-19aea9d8-4931-4a56-9fe9-f130d09b24f2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:40.436409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19aea9d8-4931-4a56-9fe9-f130d09b24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:40.483264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.585644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb99d19-f00c-4a72-a613-edfd7ba7cc21 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.615076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 84/159] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:40.623627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.624272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.624557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.624819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.625551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] RBAC: Adding query filter params (role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=248b025f240a476dadac1c918e685632, user.id=cf9ab79962264150b479a8b5c3cbbfb0) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:40.625885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.627366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bc5b1-1022-4877-8f97-2ecf62a83e5e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.633251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 76/160] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/role_assignments?user.id=cf9ab79962264150b479a8b5c3cbbfb0&scope.project.id=248b025f240a476dadac1c918e685632&role.id=82cfaa1d7baa4067892940a470beb46e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:40.736791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63edd68-3e1b-4995-b968-b884ca16de72 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.737075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63edd68-3e1b-4995-b968-b884ca16de72 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.737377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63edd68-3e1b-4995-b968-b884ca16de72 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.738879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 85/161] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:40.744629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.744934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.745178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.769560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:40.770857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:40.847148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 77/162] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:41.040682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63edd68-3e1b-4995-b968-b884ca16de72 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.081126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.164204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63edd68-3e1b-4995-b968-b884ca16de72 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.185235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.228424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.229095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.229370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.229637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.230068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.258844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:41.264133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:41.265041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:41.265857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:41.273507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 86/163] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:41.275223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.369896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3a64-1065-49b6-bfeb-80fe3a46c85b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.425805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.427310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.428082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.428361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.428632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.446167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d58919-ddaf-4d27-bd31-46571865cacf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.447069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:41.452266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:41.453141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:41.453919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 78/164] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:41.460387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.503922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.504833 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.505106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.505371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.507784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:41.508086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.509479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.525062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 87/165] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:41.531019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.704558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.727696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242184-d1c3-41d5-8998-1cb6b875e1ff None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.731012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9e0f5-fded-4bfb-bad3-b2892b199bd5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.773603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.774267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.774570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.775224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.776019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:41.776319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.778292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.787778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 79/166] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:41.789247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.811481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db8f8-bb78-4f02-b34e-f49006fa128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.812392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db8f8-bb78-4f02-b34e-f49006fa128b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.813454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db8f8-bb78-4f02-b34e-f49006fa128b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.814048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db8f8-bb78-4f02-b34e-f49006fa128b None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.817515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48db8f8-bb78-4f02-b34e-f49006fa128b None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.819302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48db8f8-bb78-4f02-b34e-f49006fa128b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.824265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 88/167] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:41.830295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683c826-0090-4423-afb0-6bdae1e75240 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.830792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683c826-0090-4423-afb0-6bdae1e75240 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.831258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683c826-0090-4423-afb0-6bdae1e75240 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.832798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 89/168] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:41.833700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683c826-0090-4423-afb0-6bdae1e75240 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.873687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.972643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fae60-3587-4b2b-af0b-3d8c7c8106fb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.986723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683c826-0090-4423-afb0-6bdae1e75240 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.023201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.024329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.024805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.025270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] PATH_INFO: `/v3/users/cf9ab79962264150b479a8b5c3cbbfb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.026840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9ab79962264150b479a8b5c3cbbfb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.028668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.030550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 90/169] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/users/cf9ab79962264150b479a8b5c3cbbfb0 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:42.031619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.067118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a1afe-3e3b-4c6f-8c42-f6f104242569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.067907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1afe-3e3b-4c6f-8c42-f6f104242569 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.068038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1afe-3e3b-4c6f-8c42-f6f104242569 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.068317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1afe-3e3b-4c6f-8c42-f6f104242569 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.096953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a1afe-3e3b-4c6f-8c42-f6f104242569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-890a1afe-3e3b-4c6f-8c42-f6f104242569 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:42.102499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:42.103378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:42.104148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:42.110220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 80/170] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:42.113840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.113840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.113840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.139059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.153986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:42.155215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:42.155766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d24940-cea7-47c5-aff9-b0a4f85bcbe3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.167888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.203231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.203878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.204152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.204428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.287321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 81/171] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:42.288364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.301300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.303151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.422767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.440697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 91/172] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:42.446588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.547831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1c88-64c0-421a-8e30-32276fc80429 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.558974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd538-7fe6-41fd-a5e5-efc397eebd99 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.614266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.615287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.615765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.616212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.617214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:42.617719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.619336 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.629839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eca5c-c47c-4f5a-9ffc-b3fe84049054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.629839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eca5c-c47c-4f5a-9ffc-b3fe84049054 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.629839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eca5c-c47c-4f5a-9ffc-b3fe84049054 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.629839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eca5c-c47c-4f5a-9ffc-b3fe84049054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.640087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 92/173] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:42.641108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.652345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.713843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.726152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eca5c-c47c-4f5a-9ffc-b3fe84049054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.727715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eca5c-c47c-4f5a-9ffc-b3fe84049054 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.787692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c325c-ff96-465b-b5f2-b34d41d4d35c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.826570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b45da-5a83-42f8-aa54-1ab7cd0cfa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.827126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b45da-5a83-42f8-aa54-1ab7cd0cfa21 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.827408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b45da-5a83-42f8-aa54-1ab7cd0cfa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.827681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b45da-5a83-42f8-aa54-1ab7cd0cfa21 None admin] PATH_INFO: `/v3/projects/f1c66e8a220b49559322e6b65712bf3c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.831948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b45da-5a83-42f8-aa54-1ab7cd0cfa21 None admin] RBAC: Authorizing `identity:get_project(project_id=f1c66e8a220b49559322e6b65712bf3c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.833430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b45da-5a83-42f8-aa54-1ab7cd0cfa21 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.835521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 93/174] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/projects/f1c66e8a220b49559322e6b65712bf3c => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:42.836693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c7769-ec96-48dc-8fc8-bc0bbfa10e17 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.836974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c7769-ec96-48dc-8fc8-bc0bbfa10e17 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.837245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c7769-ec96-48dc-8fc8-bc0bbfa10e17 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.838639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 94/175] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:42.839182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c7769-ec96-48dc-8fc8-bc0bbfa10e17 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.849488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 82/176] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:42.850963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713016-35af-45f9-906a-f55586f331c2 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.851257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713016-35af-45f9-906a-f55586f331c2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.851528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713016-35af-45f9-906a-f55586f331c2 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.861102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 83/177] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:42.862388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616277-a65b-4b8e-80de-1b908525591c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.862678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616277-a65b-4b8e-80de-1b908525591c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.862953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616277-a65b-4b8e-80de-1b908525591c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.865805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 84/178] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:42.865805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616277-a65b-4b8e-80de-1b908525591c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.908892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.949920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c7769-ec96-48dc-8fc8-bc0bbfa10e17 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.966336 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.966997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616277-a65b-4b8e-80de-1b908525591c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.984664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.985325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.985600 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.985924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] PATH_INFO: `/v3/users/bd54da1432894173a79d520df35ac9c0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.987031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] RBAC: Authorizing `identity:get_user(user_id=bd54da1432894173a79d520df35ac9c0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.988497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.990125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 95/179] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/users/bd54da1432894173a79d520df35ac9c0 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:42.990981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.003544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712097dc-a908-4d4b-a6fd-8c8e9e7aa965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.004177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712097dc-a908-4d4b-a6fd-8c8e9e7aa965 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.004447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712097dc-a908-4d4b-a6fd-8c8e9e7aa965 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.004714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712097dc-a908-4d4b-a6fd-8c8e9e7aa965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.014668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712097dc-a908-4d4b-a6fd-8c8e9e7aa965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-712097dc-a908-4d4b-a6fd-8c8e9e7aa965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:43.019470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:43.020308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:43.021074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 85/180] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:43.021703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.022270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.022270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.039647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:43.040818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:43.090508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0d6ef-b8db-4d88-9e48-7b77e7ca02e6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.105233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 86/181] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:43.110277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.123529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.124141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.124417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.124685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.125399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=f1c66e8a220b49559322e6b65712bf3c, user.id=cf9ab79962264150b479a8b5c3cbbfb0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.125718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.127215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22671ac-2454-41c6-aafc-87ac146822ce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.133344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 96/182] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/role_assignments?user.id=cf9ab79962264150b479a8b5c3cbbfb0&scope.project.id=f1c66e8a220b49559322e6b65712bf3c&role.id=8d8fadd4e1414e3da426c068de39430b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:43.134530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb55d-6218-41c6-9751-ca2f4beaa1da None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.134786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb55d-6218-41c6-9751-ca2f4beaa1da None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.135079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb55d-6218-41c6-9751-ca2f4beaa1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.151060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.154619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d1ccb55d-6218-41c6-9751-ca2f4beaa1da None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:43.155873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d1ccb55d-6218-41c6-9751-ca2f4beaa1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:43.208214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.241696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 97/183] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:43.242736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.243023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.243294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.261852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865521f2-a81e-403c-b6d6-b74e836b7ef1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.263446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:43.264726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:43.308903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.310523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.311046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.311530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.312872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.314577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.316581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 87/184] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:43.317560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.367783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 98/185] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:43.369054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.427644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7d076-25fe-4cf3-9b1a-f1c055058d2d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.446156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.465572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.466459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.466842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.467217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.476638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b4ccf-6b27-4978-bb11-475ef497aa9b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.487707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.515571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.516542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.517018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.517505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.518457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.518954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.520529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.530061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 99/186] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:43.531154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.544940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.546874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.635224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62384cb-f283-4a0a-85bc-d1bc5404ba8b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.651413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.656309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 88/187] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:43.657227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.674326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.674942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.675213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.675483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.676219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=248b025f240a476dadac1c918e685632, user.id=cf9ab79962264150b479a8b5c3cbbfb0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.676520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.678007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.684408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 100/188] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/role_assignments?user.id=cf9ab79962264150b479a8b5c3cbbfb0&scope.project.id=248b025f240a476dadac1c918e685632&role.id=8d8fadd4e1414e3da426c068de39430b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:43.685023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.731247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.768230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a602-f974-49cd-991c-0e241fb2701e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.807421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.807935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a501-a0ad-412f-b675-8dabd4a107a5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.808062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.808331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.808660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.820029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:43.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:43.826727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:43.827523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 89/189] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:43.828186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.854906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.855611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.855882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.856172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] PATH_INFO: `/v3/users/45ac523f4d2c49a89b1554aab2b7251d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.871753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] RBAC: Authorizing `identity:get_user(user_id=45ac523f4d2c49a89b1554aab2b7251d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.873328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.875208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 101/190] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/users/45ac523f4d2c49a89b1554aab2b7251d => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:43.876018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.904274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.950534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be3af-c97a-4144-af84-fc6a448ec4ba None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.977914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.984409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.985058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.985329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.985602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.987556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e82bb-64dc-4429-8ba2-1aede94a8c32 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.995516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:44.000531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:44.001395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:44.002210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 90/191] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:44.003049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.027459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.028105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.028380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.028651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.029888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.031356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.033012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 102/192] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.033867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.102855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbf1b-64e2-46ef-8ad9-53000fa6aa69 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.123518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.135604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f4a9-ba53-456a-9776-2fbc3bf3c2fb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.137667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.138371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.138708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.138978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.140041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.141491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.143245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 91/193] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.143952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.172334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.172928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.173195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.173453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.174141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:44.174428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.175849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.183481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 103/194] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.183481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.212710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.246180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4f432-d160-4e17-886e-6aba64497354 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.282519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.283230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.283399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.283668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.291498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760246-4960-432b-9e36-625f008330c4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.325203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.325979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.326271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.326525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.327210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:44.327511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.328943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.337432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 104/195] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.342308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.342772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.352321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.353810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.422273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.438849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab995a-e4d9-4901-8a2f-3597fda7548e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.453660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 92/196] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:44.458689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.473148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.473762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.474093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.474363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.475093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=248b025f240a476dadac1c918e685632, user.id=bd54da1432894173a79d520df35ac9c0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:44.475404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.476854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.483274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 105/197] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/role_assignments?user.id=bd54da1432894173a79d520df35ac9c0&scope.project.id=248b025f240a476dadac1c918e685632&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.483889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.574775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.590739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53033fc0-80f2-43bf-ad62-9030e94d281e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.605975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fd68a-a7a0-48fc-99f1-c0280e7776c3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.629984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.630608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.630889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.631162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.631846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.633373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.649539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.650534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.650858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.651127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] PATH_INFO: `/v3/users/45ac523f4d2c49a89b1554aab2b7251d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.652298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] RBAC: Authorizing `identity:get_user(user_id=45ac523f4d2c49a89b1554aab2b7251d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.653757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.655472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 106/198] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/users/45ac523f4d2c49a89b1554aab2b7251d => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.656546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.669933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 93/199] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:44 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:44.669933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.678032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.785733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1784199-9975-46fb-8040-e4af93a441e9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.808319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310de2b-8d60-4b7e-8efd-41aee835f68b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.823083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.823906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.824584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.824858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] PATH_INFO: `/v3/users/eb2dd72fe0d7413bba37d3f3a49bbfa4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.826226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] RBAC: Authorizing `identity:get_user(user_id=eb2dd72fe0d7413bba37d3f3a49bbfa4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.830478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.832609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 107/200] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/users/eb2dd72fe0d7413bba37d3f3a49bbfa4 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.833212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.858322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.859240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.859530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.859804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.860952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.862528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.864219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 94/201] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.866581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.886851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.929531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.953601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb5b9-cd79-4cb3-932a-3f62db71d802 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.998680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.999369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.999565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.999826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.001802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c322-2fec-4782-9188-cd6edc1758f2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.042805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.044781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.045064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.045336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.081423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.083450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.116874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.118413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.132858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:45.179725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:45.198876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 108/202] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:45.200071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.225865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 95/203] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:45.226566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.311714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4814d-350d-4083-a591-8aca223886fe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.328898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713181b-d0cb-49fe-abfe-778668bee5fc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.342493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:45.354430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.355404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.355871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.356338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.357499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=45ac523f4d2c49a89b1554aab2b7251d) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:45.358023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.359852 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.365028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.365673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.365979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.366252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.367401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.368542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 109/204] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:45 2022] GET /identity/v3/role_assignments?user.id=45ac523f4d2c49a89b1554aab2b7251d&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:45.368894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.369789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.370858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 96/205] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:45 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:45.376671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.427244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:45.491062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e092871-9628-41c3-af03-7b20d6c4eb56 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.537111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.538284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.538844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.539358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.540786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.542590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.545128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 110/206] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:45 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:45.552034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.594884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ee94-4db9-4b53-a2ed-c01e5ad7f280 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.639312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.640689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.640975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.641252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.642020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] RBAC: Adding query filter params (role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=45ac523f4d2c49a89b1554aab2b7251d) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:45.642330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.643788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56866ec8-434f-4fc3-86b3-70816b6a35e9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.650493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 97/207] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:45 2022] GET /identity/v3/role_assignments?user.id=45ac523f4d2c49a89b1554aab2b7251d&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=82cfaa1d7baa4067892940a470beb46e => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:45.681594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0b08-632b-416e-b8af-f6bcbbe5af79 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.700752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:45.720251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.721164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.721585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.722092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.722976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] RBAC: Adding query filter params (role.id=cde012161d59480cb7d2d8bd7c10763e, scope.project.id=248b025f240a476dadac1c918e685632, user.id=eb2dd72fe0d7413bba37d3f3a49bbfa4) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:45.723419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.725038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114c3b8-5d84-4ff3-818e-9a1344955b03 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.732170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 111/208] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:45 2022] GET /identity/v3/role_assignments?user.id=eb2dd72fe0d7413bba37d3f3a49bbfa4&scope.project.id=248b025f240a476dadac1c918e685632&role.id=cde012161d59480cb7d2d8bd7c10763e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:46.833082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06687-dc51-4320-8870-74dc2906d803 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.833625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06687-dc51-4320-8870-74dc2906d803 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.833625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06687-dc51-4320-8870-74dc2906d803 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.835039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 98/209] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:46.840466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.840885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.841048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.862289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:46.863480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:46.882158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901746-ee65-45a0-b14b-c7bf9e54f28c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.882761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901746-ee65-45a0-b14b-c7bf9e54f28c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.883233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901746-ee65-45a0-b14b-c7bf9e54f28c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.884932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 99/210] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:46.891147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.891688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.892154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.913099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:46.914686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:46.942296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 112/211] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:46.962555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.997882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 100/212] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:47.218634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.270976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.322855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e1a0-2308-4b1a-83fd-4c04c96e9424 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.335082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.359996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.360798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.361177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.361539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.372988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:47.378343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:47.379408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:47.380275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:47.381153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 113/213] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:47.381891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29a54-548d-41fe-95cd-705456f7eaaa None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.390923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.418402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.419361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.419812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.420317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.421608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.423846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.425983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 101/214] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:47.431581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.477590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.503823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdbe20-6011-46ae-8d66-e16daeb2b2ad None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.537615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a32bed-3afc-4530-99a0-0c388a12cb89 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.541060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.541725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.542037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.542309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.542970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:47.543266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.544689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a4d14-3aa9-4903-b61b-8857f40ade5d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.555157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 114/215] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:47.560851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1faf79-b2ba-493d-ad9f-19f49758cc6c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.561153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1faf79-b2ba-493d-ad9f-19f49758cc6c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.561398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1faf79-b2ba-493d-ad9f-19f49758cc6c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.565819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 115/216] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:47.565819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1faf79-b2ba-493d-ad9f-19f49758cc6c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.578295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4347d7-87f6-4bb2-b9e3-e120b27c8aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.578933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4347d7-87f6-4bb2-b9e3-e120b27c8aed None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.579210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4347d7-87f6-4bb2-b9e3-e120b27c8aed None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.579483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4347d7-87f6-4bb2-b9e3-e120b27c8aed None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.580144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4347d7-87f6-4bb2-b9e3-e120b27c8aed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.581620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4347d7-87f6-4bb2-b9e3-e120b27c8aed None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.597303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.606578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 102/217] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:47 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:40:47.611209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f71c-8a22-4a5b-b6c6-3a9128acdd8a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.611561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f71c-8a22-4a5b-b6c6-3a9128acdd8a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.611758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f71c-8a22-4a5b-b6c6-3a9128acdd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.639958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2339f71c-8a22-4a5b-b6c6-3a9128acdd8a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:47.642528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2339f71c-8a22-4a5b-b6c6-3a9128acdd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:47.703469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1faf79-b2ba-493d-ad9f-19f49758cc6c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.735301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 103/218] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:47.748928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc62c19-d69e-42af-9f20-2dcccb5b6f2c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.749243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc62c19-d69e-42af-9f20-2dcccb5b6f2c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.749459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.749585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc62c19-d69e-42af-9f20-2dcccb5b6f2c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.750096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.750368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.750631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] PATH_INFO: `/v3/users/87bd98f92384423aa74b0605937d6ab7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.751212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 104/219] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:47.759676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.759676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.759901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.765709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] RBAC: Authorizing `identity:get_user(user_id=87bd98f92384423aa74b0605937d6ab7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.768203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.770174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 116/220] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/users/87bd98f92384423aa74b0605937d6ab7 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:47.775508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.779776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:47.780970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:47.809096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.874926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 105/221] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:47.907042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.922715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac1380-0bf2-4f3c-b177-e4ade660c7f7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.960673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.961286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.961565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.961905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.012696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.035141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.036690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.144686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69b8f9-3f6f-4726-8ff0-caa08552394b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.167188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.184474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 117/222] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:40:48.185162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.196316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.196970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.197251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.197527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.209875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:48.216531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:48.217455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 106/223] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:48.218877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.245626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.318476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3701f-ae56-4ca3-834b-26f18552a273 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.352195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f798247-da2e-4e32-ac63-dc69c8ca3689 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.366063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.366730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.367005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.367273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.381974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:48.388159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:48.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:48.390285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:48.392626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.393521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.394018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.394429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 118/224] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:48.394882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.395777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.396462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.398368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.400433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 107/225] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.401438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.452407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.513594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6d56-57cb-4878-a18f-3ce91b8d0ff2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.535199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973163d-042d-4c92-9f90-69cd373b5cb8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.536926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.552451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.553372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.553948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.554409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.555285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.555780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.557364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.566296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 119/226] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.570937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.577386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.578049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.578331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.578602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.579278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.579584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.580994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.592042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 108/227] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.592783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.702903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250eaf2-05e0-4bb1-b4f3-7ab7dcda77cc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.716024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7016a5-4129-4f15-b585-68f1b4fb4d3c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.716876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.746212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.746850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.747505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.747789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.748603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=87bd98f92384423aa74b0605937d6ab7) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.748912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.750932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.758520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 120/228] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/role_assignments?user.id=87bd98f92384423aa74b0605937d6ab7&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=8d8fadd4e1414e3da426c068de39430b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.762702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.766674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.767665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.768603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.770509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] PATH_INFO: `/v3/users/45ac523f4d2c49a89b1554aab2b7251d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.774228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] RBAC: Authorizing `identity:get_user(user_id=45ac523f4d2c49a89b1554aab2b7251d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.777227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.784911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 109/229] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/users/45ac523f4d2c49a89b1554aab2b7251d => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.791651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.827305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.939584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4b281-605d-4245-9b09-3f3b05081281 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.945757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a066-4ebb-4017-8077-9257fba3fe7b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.986320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.986956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.987240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.987512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] PATH_INFO: `/v3/users/45ac523f4d2c49a89b1554aab2b7251d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.988651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] RBAC: Authorizing `identity:get_user(user_id=45ac523f4d2c49a89b1554aab2b7251d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.990876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.991918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 121/230] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/users/45ac523f4d2c49a89b1554aab2b7251d => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.998578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.003984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.004641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.004919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.005191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.010545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.012268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.014461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 110/231] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:49.023253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.078729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:49.119980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:49.141403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6933-94f0-43ea-b26b-cb605e41fa5b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.177585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.178287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.178562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.178832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/45ac523f4d2c49a89b1554aab2b7251d/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.180832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] RBAC: Authorizing `identity:create_grant(project_id=5f30f0ced3f84e0fbf1b5e4614734b35, user_id=45ac523f4d2c49a89b1554aab2b7251d, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.182450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.198089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 111/232] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:49 2022] PUT /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/45ac523f4d2c49a89b1554aab2b7251d/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:49.213097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a8560-d954-4e5e-8cf1-da22862b6add None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.269250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0dcfd-cdaa-4462-a7cc-2a0461991474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.269954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0dcfd-cdaa-4462-a7cc-2a0461991474 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.270233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0dcfd-cdaa-4462-a7cc-2a0461991474 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.270504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0dcfd-cdaa-4462-a7cc-2a0461991474 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.271751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0dcfd-cdaa-4462-a7cc-2a0461991474 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.273276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0dcfd-cdaa-4462-a7cc-2a0461991474 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.275169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 122/233] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:49.281314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.407971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a6ebd-e687-4d64-a5f8-13b506535e3e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.444104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5b23-c596-4035-a98a-f3f80f5c1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.444780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5b23-c596-4035-a98a-f3f80f5c1b70 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.445058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5b23-c596-4035-a98a-f3f80f5c1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.445331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5b23-c596-4035-a98a-f3f80f5c1b70 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/45ac523f4d2c49a89b1554aab2b7251d/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.447525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5b23-c596-4035-a98a-f3f80f5c1b70 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f30f0ced3f84e0fbf1b5e4614734b35, user_id=45ac523f4d2c49a89b1554aab2b7251d, role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.449081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5b23-c596-4035-a98a-f3f80f5c1b70 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.468022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 112/234] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:49 2022] PUT /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/45ac523f4d2c49a89b1554aab2b7251d/roles/82cfaa1d7baa4067892940a470beb46e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:49.985034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f7ab8-9e8b-4f54-854a-4876efc1dd30 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.985557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f7ab8-9e8b-4f54-854a-4876efc1dd30 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.985557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f7ab8-9e8b-4f54-854a-4876efc1dd30 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.987257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 123/235] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:49.992874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.993351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.993423 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.000883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:50.018059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:50.019520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:50.076226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e568f-3b4d-4527-83a1-5b3c34faa132 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.076579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e568f-3b4d-4527-83a1-5b3c34faa132 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.076799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e568f-3b4d-4527-83a1-5b3c34faa132 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.078377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 124/236] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:50.085102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.085375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.085645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.110585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:50.111680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:50.142370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 113/237] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:50.223704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 125/238] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 10:40:50.496890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.609742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02bcc-be82-4afd-beff-58d12970db7c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.662650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.667421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.668322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.668805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.669255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.670659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.672352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.674833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 114/239] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:50.685310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.689215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:50.737501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:50.847678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff7c54-3a05-4572-81ec-2f2cca8d6aa8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.866095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0bb7e-e6b7-4a6c-b21b-bdb0d949d04f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.905340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.905996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.906276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.906547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.907205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.908674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.918846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.919494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.919768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.920036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.939043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:50.944051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:50.945045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:50.946111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 126/240] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:50.961997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 115/241] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:50 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:50.963224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.094379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ca52d-5802-483d-95e1-d046156e7726 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.095956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.150996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14178445-aaf7-4212-8988-464174a81996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.151535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14178445-aaf7-4212-8988-464174a81996 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.151810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14178445-aaf7-4212-8988-464174a81996 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.152080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14178445-aaf7-4212-8988-464174a81996 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.152760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14178445-aaf7-4212-8988-464174a81996 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:51.153055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14178445-aaf7-4212-8988-464174a81996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.154503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14178445-aaf7-4212-8988-464174a81996 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.169783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 127/242] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:51.175983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.232102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4ceb-6471-4e69-aa4a-252e8bac83b1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.232478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4ceb-6471-4e69-aa4a-252e8bac83b1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.232656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4ceb-6471-4e69-aa4a-252e8bac83b1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.234433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 128/243] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:51.239480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.239762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.240031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.261166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:51.262479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:51.271084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.302409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41370b-5996-416f-887b-9f746b3543fa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.347689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081db6-99d8-4345-a8d7-0c084b70c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.348372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081db6-99d8-4345-a8d7-0c084b70c18b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.348650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081db6-99d8-4345-a8d7-0c084b70c18b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.348925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081db6-99d8-4345-a8d7-0c084b70c18b None admin] PATH_INFO: `/v3/users/a586b790e79749e1901aa3609a7d5669` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.363507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 129/244] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:51.369410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081db6-99d8-4345-a8d7-0c084b70c18b None admin] RBAC: Authorizing `identity:get_user(user_id=a586b790e79749e1901aa3609a7d5669)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.370843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081db6-99d8-4345-a8d7-0c084b70c18b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.372228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 116/245] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/users/a586b790e79749e1901aa3609a7d5669 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:51.378174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.480133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.487187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d5c23-c14b-4dcb-8da7-1a65cbc55e98 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.527908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.528551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.528826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.529092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.603284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.604766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.622812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277cb1-8472-492e-b6b6-4bdc3439a76b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.623175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277cb1-8472-492e-b6b6-4bdc3439a76b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.623352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277cb1-8472-492e-b6b6-4bdc3439a76b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.624918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 117/246] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:51.630282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.630552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.630824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.661276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:51.662810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:51.722266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.733346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 130/247] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:51.734175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.754194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 118/248] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:51.755736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.822174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.866005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64238e0e-a45b-4512-98ce-934c0d5484dd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.881595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0b37c-4830-451d-b572-18022af6dd97 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.912054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.912804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.913129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.913490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.923464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c056ca-3678-4c05-aa12-00a1b36d821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.924109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c056ca-3678-4c05-aa12-00a1b36d821d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.924383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c056ca-3678-4c05-aa12-00a1b36d821d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.924800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c056ca-3678-4c05-aa12-00a1b36d821d None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.925366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:51.926146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c056ca-3678-4c05-aa12-00a1b36d821d None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.927615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c056ca-3678-4c05-aa12-00a1b36d821d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.929262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 119/249] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:51.930417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d01f-9793-4ec4-9efb-c3e3b0688c83 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:51.930659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:51.931497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:51.932912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:51.933749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d01f-9793-4ec4-9efb-c3e3b0688c83 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.933749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d01f-9793-4ec4-9efb-c3e3b0688c83 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.934135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 131/250] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:51.934217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 120/251] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:51.938029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.938307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.938583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.941469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.970292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:51.971478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:52.044011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.057441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 121/252] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:52.065797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.140444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.148738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d218-95a5-479f-8d59-fe65fabe4704 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.203867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.204505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.204773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.205037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.205758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] RBAC: Adding query filter params (role.id=cde012161d59480cb7d2d8bd7c10763e, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=a586b790e79749e1901aa3609a7d5669) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.206083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.207537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.222248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 132/253] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/role_assignments?user.id=a586b790e79749e1901aa3609a7d5669&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=cde012161d59480cb7d2d8bd7c10763e => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.223084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.256325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9d56b-03d8-46ec-9708-12dfe60b9ae4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.326631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.327370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.327640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.327902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.328573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.328867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.330581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.351479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 122/254] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.355183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.429534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32905-818b-45f3-99f3-c3346b436770 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.449730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.468566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.469202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.469474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.469738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.481415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:52.488125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:52.489062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:52.489858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 133/255] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:52.490525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.508248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094d176-a03d-41fe-a2c9-dabf408e837e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.518587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.554789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.555533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.556363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.556717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] PATH_INFO: `/v3/users/87bd98f92384423aa74b0605937d6ab7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.558312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] RBAC: Authorizing `identity:get_user(user_id=87bd98f92384423aa74b0605937d6ab7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.559981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.562303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 123/256] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/users/87bd98f92384423aa74b0605937d6ab7 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.563378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.629184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c0bd-291a-4548-aaad-fa62f1ee40a9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.686039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.686715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.686988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.687257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.713985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:52.718915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:52.719748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:52.720520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 134/257] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:52.721152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.726328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995a18d-29a5-41bd-99f0-345772404639 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.782790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.783402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.783676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.783950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.784611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.784912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.786335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.808620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 124/258] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.809496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.810294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.898207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.927332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8ebc5-fd82-4a6d-b66f-94d51c656f56 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.971534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.972700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.973161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.973659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.978662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.980634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.982875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 135/259] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.983961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.996583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53c4e-0a5d-4ffd-a2c2-dd2ed29510ae None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.039319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.039956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.040242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.040511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.041185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:53.041488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.042948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.065406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 125/260] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:53.066179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.183866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de219e2e-09c7-4c69-b271-a6b2b097ad61 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.194744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.250157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.254453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3c605-6d07-405d-8de0-e2eab6f6391a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.291382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.292157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.292315 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.292594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/87bd98f92384423aa74b0605937d6ab7/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.294471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.294609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f30f0ced3f84e0fbf1b5e4614734b35, user_id=87bd98f92384423aa74b0605937d6ab7, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.295123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.295401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.295698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] PATH_INFO: `/v3/users/45ac523f4d2c49a89b1554aab2b7251d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.296017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.302468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] RBAC: Authorizing `identity:get_user(user_id=45ac523f4d2c49a89b1554aab2b7251d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.303968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.306071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 136/261] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/users/45ac523f4d2c49a89b1554aab2b7251d => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:53.306976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.311449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 126/262] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:53 2022] PUT /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/87bd98f92384423aa74b0605937d6ab7/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:53.312636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.449688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fe14-5178-4ed3-926a-3f96c403ced8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.516803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af6a9-c4df-4872-9834-03d6cd78f818 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.530591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf39726-869c-4ee6-809f-3ad6037ed383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.531329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39726-869c-4ee6-809f-3ad6037ed383 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.531680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39726-869c-4ee6-809f-3ad6037ed383 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.532020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf39726-869c-4ee6-809f-3ad6037ed383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.560317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.561337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.562273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.562738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] PATH_INFO: `/v3/users/45ac523f4d2c49a89b1554aab2b7251d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.564419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] RBAC: Authorizing `identity:get_user(user_id=45ac523f4d2c49a89b1554aab2b7251d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.566798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.569756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 137/263] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/users/45ac523f4d2c49a89b1554aab2b7251d => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:53.578829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.588792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.645440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.698848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf39726-869c-4ee6-809f-3ad6037ed383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.700435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf39726-869c-4ee6-809f-3ad6037ed383 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.705209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb847-c7af-4d61-beb8-e64bc4a268e3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.742225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015100f8-2f1c-4e48-94c1-010cdaf61eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.743132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015100f8-2f1c-4e48-94c1-010cdaf61eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.743132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015100f8-2f1c-4e48-94c1-010cdaf61eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.743405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015100f8-2f1c-4e48-94c1-010cdaf61eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.816688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015100f8-2f1c-4e48-94c1-010cdaf61eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.818249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015100f8-2f1c-4e48-94c1-010cdaf61eb8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.874348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.934570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 138/264] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:53.936156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe1a86-2551-4613-aa42-d27127ede2a0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.936727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe1a86-2551-4613-aa42-d27127ede2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.937161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe1a86-2551-4613-aa42-d27127ede2a0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.938579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 139/265] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:53.941917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe1a86-2551-4613-aa42-d27127ede2a0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.045060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe1a86-2551-4613-aa42-d27127ede2a0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.052307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 127/266] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:54.053689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.053869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.054137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.081303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.082300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.082884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.083326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.084657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:54.086398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:54.088564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 140/267] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:54.089540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.106159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.106803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:54.108023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:54.218611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa64de-ee33-42d0-8f02-ee3ac3ff6fd7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.224684 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.253485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 128/268] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:54.254855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.283850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f67c46-35c1-4b01-aa33-60e047297d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.284824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67c46-35c1-4b01-aa33-60e047297d21 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.285300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67c46-35c1-4b01-aa33-60e047297d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.285755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67c46-35c1-4b01-aa33-60e047297d21 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.287171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f67c46-35c1-4b01-aa33-60e047297d21 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:54.288839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f67c46-35c1-4b01-aa33-60e047297d21 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:54.290751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 141/269] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:54 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:54.292190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc01b6-ed9e-493b-91b2-05ab700a3ea8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.292663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc01b6-ed9e-493b-91b2-05ab700a3ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.293100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc01b6-ed9e-493b-91b2-05ab700a3ea8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.294505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 142/270] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:54.296447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc01b6-ed9e-493b-91b2-05ab700a3ea8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.394184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.415751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc01b6-ed9e-493b-91b2-05ab700a3ea8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.479000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a449f9-4fbf-4d98-bf11-4f3a45770077 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.490353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.491197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.491644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.492102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.493043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=45ac523f4d2c49a89b1554aab2b7251d) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:54.493566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:54.495240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa14258-f479-4ece-a865-2fe0e72d5f7e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:54.508112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 143/271] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:54 2022] GET /identity/v3/role_assignments?user.id=45ac523f4d2c49a89b1554aab2b7251d&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:54.509140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005d28-515a-44d1-bee8-aaaee349ec22 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.509420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005d28-515a-44d1-bee8-aaaee349ec22 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.509691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005d28-515a-44d1-bee8-aaaee349ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.531596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.532574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.533049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.533538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.534522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] RBAC: Adding query filter params (role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=45ac523f4d2c49a89b1554aab2b7251d) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:54.535000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:54.536639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:54.548700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8b005d28-515a-44d1-bee8-aaaee349ec22 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:54.551343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 129/272] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:54 2022] GET /identity/v3/role_assignments?user.id=45ac523f4d2c49a89b1554aab2b7251d&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=82cfaa1d7baa4067892940a470beb46e => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:54.553175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8b005d28-515a-44d1-bee8-aaaee349ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:54.648225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 144/273] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:54.715277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.727894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1a18a-11a2-4518-9c37-cad737e23814 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.728484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1a18a-11a2-4518-9c37-cad737e23814 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.729379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1a18a-11a2-4518-9c37-cad737e23814 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.731845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 145/274] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:54.737476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.738263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.738753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.774922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:54.776151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:54.810850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.864862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 146/275] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:54.901563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa193df-8e51-40c5-9802-3fcae21a1bb7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.942114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.942954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.943286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.943556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.956307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:54.961940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:54.963031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:54.964129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 130/276] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:54.971828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.975129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.019675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.107302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb42309-5c87-475b-9408-bf62b4e1387c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.153526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.154647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.155019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.155494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.157142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:55.157616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.159850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.161335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733f93-83e7-4eca-a30b-5aa94ad3bc03 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.170181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 147/277] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:55.176147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.178618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.208181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.209285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.209911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.210257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.211511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.213950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.215558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 131/278] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:55.216501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.247134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.288309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543d86-0ef8-49a1-bd15-b47e23eba008 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.322951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.323705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.324004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.324241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] PATH_INFO: `/v3/users/ea3b6aee0cc54f7cb09077dfc96f1c3c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.325485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf8b2-cb42-459b-8964-be115e6d8a85 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.338408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] RBAC: Authorizing `identity:get_user(user_id=ea3b6aee0cc54f7cb09077dfc96f1c3c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.339789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.341454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 148/279] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/users/ea3b6aee0cc54f7cb09077dfc96f1c3c => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:55.342209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.367783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.368122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.368404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.368677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.379840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:55.385189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:55.386349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 132/280] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:55.387149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.437595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.460489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeba121-e175-4a82-8359-18b5dbed410b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.483730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.496329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.496965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.497242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.497512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.498201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.499788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.500764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ad4c-733a-46b0-b6cb-132011c4254e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.526037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 149/281] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:55 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:55.526798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.549146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.549877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.550142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.550414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.551340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, user.id=ea3b6aee0cc54f7cb09077dfc96f1c3c, scope.system=all) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:55.551620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.553258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.561237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 133/282] 10.222.0.75 () {56 vars in 1308 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/role_assignments?user.id=ea3b6aee0cc54f7cb09077dfc96f1c3c&scope.system=all&role.id=8d8fadd4e1414e3da426c068de39430b => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:55.668803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fd68-5e9b-4ae5-9cd3-ae2bf1d22a59 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.710853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.711953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.712482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.712957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.713849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:55.714304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.715872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.727150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 150/283] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:55.733502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.838963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e53ae-dc63-4888-883b-ad29741309b2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.841485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.876038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58284a3-0ba4-44e7-93ec-86853b70e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.876693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58284a3-0ba4-44e7-93ec-86853b70e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.876968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58284a3-0ba4-44e7-93ec-86853b70e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.877239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58284a3-0ba4-44e7-93ec-86853b70e0a2 None admin] PATH_INFO: `/v3/users/a586b790e79749e1901aa3609a7d5669` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.878394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58284a3-0ba4-44e7-93ec-86853b70e0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=a586b790e79749e1901aa3609a7d5669)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.879874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58284a3-0ba4-44e7-93ec-86853b70e0a2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.881603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 134/284] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/users/a586b790e79749e1901aa3609a7d5669 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:55.887398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.899614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf272ed-723a-4544-a4c5-4d36cf0a39ab None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.900230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf272ed-723a-4544-a4c5-4d36cf0a39ab None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.900708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf272ed-723a-4544-a4c5-4d36cf0a39ab None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.902716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 135/285] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:55.907873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.908433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.908954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.939090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:55.940635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:55.958555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.014613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 136/286] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:56.030693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397eb86-20c8-475f-920e-100ea500723e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.075987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.076810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.077217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.078819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.081583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.083115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.085148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 151/287] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:56.090940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.220181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206589c2-2db0-47d9-b0c2-7c0e138e6652 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.221693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.265054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.265854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.266134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.266413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/a586b790e79749e1901aa3609a7d5669/roles/cde012161d59480cb7d2d8bd7c10763e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.268359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] RBAC: Authorizing `identity:create_grant(project_id=5f30f0ced3f84e0fbf1b5e4614734b35, user_id=a586b790e79749e1901aa3609a7d5669, role_id=cde012161d59480cb7d2d8bd7c10763e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.269867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.286179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 137/288] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:56 2022] PUT /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/users/a586b790e79749e1901aa3609a7d5669/roles/cde012161d59480cb7d2d8bd7c10763e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:56.527525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.634279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fb10-6452-4f6e-9bec-83d9478a17aa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.643231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.671846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.672509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.672781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.673049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.688565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:56.693989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:56.694874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:56.695674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:56.696345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 152/289] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:56.702208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.828205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d0f97-8b31-4576-a93e-fbac4b919adc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.863048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.863954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.864235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.864501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.865170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:56.865471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.866902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.876160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 138/290] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:56.881815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.023411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c479-8d94-4641-b193-8eb0aa385415 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.057586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.058259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.058538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.058811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] PATH_INFO: `/v3/users/87bd98f92384423aa74b0605937d6ab7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.059944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] RBAC: Authorizing `identity:get_user(user_id=87bd98f92384423aa74b0605937d6ab7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.061483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.063492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 153/291] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/users/87bd98f92384423aa74b0605937d6ab7 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:57.071029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.107231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.193878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5beccd-b612-40e4-8f7f-0e1ce38fe28b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.232266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.232889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.233165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.233436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.314081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.315585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.341905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.418559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 139/292] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:57.427214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.463747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.541249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf114-75c3-4ab9-87c7-13907342f839 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.579816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c74d8-0c14-45a0-bd34-040acf7a815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.580455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c74d8-0c14-45a0-bd34-040acf7a815a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.580732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c74d8-0c14-45a0-bd34-040acf7a815a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.581000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c74d8-0c14-45a0-bd34-040acf7a815a None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.582176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c74d8-0c14-45a0-bd34-040acf7a815a None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.583607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c74d8-0c14-45a0-bd34-040acf7a815a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.585578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 154/293] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:57.591628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.725900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a24b2-d2ef-43f9-ba4d-75c370188939 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.763395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.772095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.773004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.773334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.773604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.774418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=87bd98f92384423aa74b0605937d6ab7) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:57.774716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.776248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507140-ce4a-482e-b404-ab356877ba9b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.782976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 140/294] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/role_assignments?user.id=87bd98f92384423aa74b0605937d6ab7&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=8d8fadd4e1414e3da426c068de39430b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:57.871127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362ddec-f0b1-4e9d-b0d7-2f031e886bc3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.871447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362ddec-f0b1-4e9d-b0d7-2f031e886bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.871753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362ddec-f0b1-4e9d-b0d7-2f031e886bc3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.873498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 155/295] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:57.879315 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935efb-91c6-4077-8ed1-2f9803379188 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.879593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935efb-91c6-4077-8ed1-2f9803379188 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.879866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935efb-91c6-4077-8ed1-2f9803379188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.908077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-81935efb-91c6-4077-8ed1-2f9803379188 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:57.909294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-81935efb-91c6-4077-8ed1-2f9803379188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:58.005050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 141/296] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:58.052389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c34fd-3cea-4d06-9429-38c2387c1a9d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.053005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c34fd-3cea-4d06-9429-38c2387c1a9d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.053470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c34fd-3cea-4d06-9429-38c2387c1a9d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.055130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 156/297] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:58.060800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e0e41-c9a0-4311-8f08-9d04ae5f5ca6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.061330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e0e41-c9a0-4311-8f08-9d04ae5f5ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.061829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e0e41-c9a0-4311-8f08-9d04ae5f5ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.082290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1e0e0e41-c9a0-4311-8f08-9d04ae5f5ca6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:58.083829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1e0e0e41-c9a0-4311-8f08-9d04ae5f5ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:58.157901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 142/298] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:58.279038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b58f-d219-41ec-a972-fbefda2c19b4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.279224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b58f-d219-41ec-a972-fbefda2c19b4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.279508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b58f-d219-41ec-a972-fbefda2c19b4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.281178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 157/299] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:58.289974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.289974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.289974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.299814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b58f-d219-41ec-a972-fbefda2c19b4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.308361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:58.309539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:58.361807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.395957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 143/300] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:58.431812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b58f-d219-41ec-a972-fbefda2c19b4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.435188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.465865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.473389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.474061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.474334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.474604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.485165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:58.490567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:58.491432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:58.492204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 158/301] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:58.499194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.586088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2628b-8093-4066-8d68-a7f46ce659f7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.622946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.623746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.624024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.624340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.630672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab7813-edfe-443a-8e82-4a6cc59735f3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.636213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:58.641466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:58.642371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:58.643140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 144/302] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:58.648484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.675467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.676629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.677134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.677578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.678577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:58.678962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.680999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.692067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.694681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 159/303] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:58.700314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.735410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.767482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0d708-99c9-4f5b-b8a5-9fbc893e0888 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.804018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.804637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.804907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.805179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.805866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:58.806167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.807580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.814777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63054-c09c-42cd-bdc7-08035b6d5494 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.815934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 145/304] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:58.818675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.849538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.850205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.850480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.850744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] PATH_INFO: `/v3/users/ea3b6aee0cc54f7cb09077dfc96f1c3c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.851901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] RBAC: Authorizing `identity:get_user(user_id=ea3b6aee0cc54f7cb09077dfc96f1c3c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.853383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.855200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 160/305] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/users/ea3b6aee0cc54f7cb09077dfc96f1c3c => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:58.855713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.936482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.939713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba753f3-4a85-4937-8cf6-490f48a5a93f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.952990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.959685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5948-b494-4629-a90d-9e6d19655b0c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.973385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.974047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.974321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.974593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.975675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.977124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.979066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 146/306] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:58.979714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.996977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc5a0a-c0ea-44e2-8772-f4d9cb542502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.997613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc5a0a-c0ea-44e2-8772-f4d9cb542502 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.997923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc5a0a-c0ea-44e2-8772-f4d9cb542502 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.998164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc5a0a-c0ea-44e2-8772-f4d9cb542502 None admin] PATH_INFO: `/v3/users/cddb9b60b9b441458b3533efb00cbc65` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.011548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc5a0a-c0ea-44e2-8772-f4d9cb542502 None admin] RBAC: Authorizing `identity:get_user(user_id=cddb9b60b9b441458b3533efb00cbc65)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:59.013006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc5a0a-c0ea-44e2-8772-f4d9cb542502 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:59.014677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 161/307] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/users/cddb9b60b9b441458b3533efb00cbc65 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:59.015876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d90d0-67d5-4e76-95a2-31e45bd4ad2a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.016157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d90d0-67d5-4e76-95a2-31e45bd4ad2a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.016427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d90d0-67d5-4e76-95a2-31e45bd4ad2a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.017925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 162/308] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:59.018616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d90d0-67d5-4e76-95a2-31e45bd4ad2a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:59.079775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9590b3-03c6-4cfd-b1b1-8971093f0632 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:59.114637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:59.115215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.115496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.115813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] PATH_INFO: `/v3/system/users/ea3b6aee0cc54f7cb09077dfc96f1c3c/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.117099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d90d0-67d5-4e76-95a2-31e45bd4ad2a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:59.117212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea3b6aee0cc54f7cb09077dfc96f1c3c, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:59.118590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:59.129012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 147/309] 10.222.0.75 () {58 vars in 1334 bytes} [Wed Aug 31 10:40:58 2022] PUT /identity/v3/system/users/ea3b6aee0cc54f7cb09077dfc96f1c3c/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:59.129799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:59.156254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d0c4-7ab9-4146-a19c-d16c208787c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:59.157189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d0c4-7ab9-4146-a19c-d16c208787c1 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.157598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d0c4-7ab9-4146-a19c-d16c208787c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.158030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d0c4-7ab9-4146-a19c-d16c208787c1 None admin] PATH_INFO: `/v3/groups` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.158815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d0c4-7ab9-4146-a19c-d16c208787c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:59.160472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d0c4-7ab9-4146-a19c-d16c208787c1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:59.163178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:59.194226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 163/310] 10.222.0.75 () {60 vars in 1134 bytes} [Wed Aug 31 10:40:59 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:59.195966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.196421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.196835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.220951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:59.222519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:59.233728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:59.257428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949ccb-bb69-4028-865c-98933cf069ab None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:59.302524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954000a0-109e-416c-9400-d8882c974424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:59.303151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954000a0-109e-416c-9400-d8882c974424 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.303490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954000a0-109e-416c-9400-d8882c974424 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.303790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954000a0-109e-416c-9400-d8882c974424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.304527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954000a0-109e-416c-9400-d8882c974424 None admin] RBAC: Adding query filter params (role.id=cde012161d59480cb7d2d8bd7c10763e, user.id=cddb9b60b9b441458b3533efb00cbc65, scope.system=all) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:59.304883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954000a0-109e-416c-9400-d8882c974424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:59.306612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954000a0-109e-416c-9400-d8882c974424 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:59.313651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 148/311] 10.222.0.75 () {56 vars in 1308 bytes} [Wed Aug 31 10:40:59 2022] GET /identity/v3/role_assignments?user.id=cddb9b60b9b441458b3533efb00cbc65&scope.system=all&role.id=cde012161d59480cb7d2d8bd7c10763e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:59.319425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 164/312] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:59.603040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954000a0-109e-416c-9400-d8882c974424 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:59.701261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:59.707547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954000a0-109e-416c-9400-d8882c974424 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:59.746750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:59.747393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.747671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.748128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.758562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:59.764024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:59.764880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:40:59.766321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 149/313] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:59.771218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:59.880720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347a82-8ec6-4b7e-ac47-ad325b9b4ed4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:59.915550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:59.916167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.916440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.916708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.917381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:59.917685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:59.919110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:59.928279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 165/314] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:59.933948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.035491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431f33-326e-4887-ba79-a1077ffe6ea2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.070468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.071115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.071402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.071677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] PATH_INFO: `/v3/users/a586b790e79749e1901aa3609a7d5669` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.072821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] RBAC: Authorizing `identity:get_user(user_id=a586b790e79749e1901aa3609a7d5669)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.074471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.076196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 150/315] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:40:59 2022] GET /identity/v3/users/a586b790e79749e1901aa3609a7d5669 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:00.082311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.086268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.185850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e536-eb0e-4712-baf5-c5df75191ec9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.221112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.221732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.222040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.222314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.294785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.296292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.299547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.399126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 166/316] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:00.404909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.431467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.508584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4767-edad-4c97-9154-70a0d330227d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.542087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a75f4-84ea-4846-b64c-8dd5492851eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.542732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a75f4-84ea-4846-b64c-8dd5492851eb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.543010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a75f4-84ea-4846-b64c-8dd5492851eb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.543279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a75f4-84ea-4846-b64c-8dd5492851eb None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.544410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a75f4-84ea-4846-b64c-8dd5492851eb None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.545894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a75f4-84ea-4846-b64c-8dd5492851eb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.547875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 151/317] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:00.554087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.661142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fdc04-3a16-4211-91ee-dcdd218ea1ee None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.674874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.696698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.697308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.697581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.697887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.698624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] RBAC: Adding query filter params (role.id=cde012161d59480cb7d2d8bd7c10763e, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35, user.id=a586b790e79749e1901aa3609a7d5669) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:00.698933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.700394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58de5-3eea-4b3a-99e5-2aada2587176 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.706582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 167/318] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/role_assignments?user.id=a586b790e79749e1901aa3609a7d5669&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=cde012161d59480cb7d2d8bd7c10763e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:01.154219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb8bab-b0a5-4e42-adce-d8159b6fb237 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.154823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb8bab-b0a5-4e42-adce-d8159b6fb237 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.154823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb8bab-b0a5-4e42-adce-d8159b6fb237 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.156150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 152/319] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:01.161568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2dc2d-a786-4023-afa2-c5006f81dc1a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.162015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2dc2d-a786-4023-afa2-c5006f81dc1a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.162108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2dc2d-a786-4023-afa2-c5006f81dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.181380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-14f2dc2d-a786-4023-afa2-c5006f81dc1a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:01.182617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-14f2dc2d-a786-4023-afa2-c5006f81dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:01.205621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53f26-dbe1-41fc-96e1-254204138e6a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.205953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53f26-dbe1-41fc-96e1-254204138e6a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.206468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53f26-dbe1-41fc-96e1-254204138e6a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.207759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 153/320] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:01.213383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.213738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.214104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.232346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:01.233539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:01.257938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 168/321] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:01.294311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ff5b-638e-4aef-bfd5-33771f344862 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.294582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ff5b-638e-4aef-bfd5-33771f344862 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.295014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ff5b-638e-4aef-bfd5-33771f344862 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.296361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 169/322] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:01.301472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.301840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.302109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.305801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 154/323] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:01.320954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:01.322395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:01.390735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 170/324] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:01.522254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.547470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.583147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.612976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.629404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4399-2998-4464-8e5e-e10eb22e6e00 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.667092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.667761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.668036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.668304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.687589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:01.690670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23a118-da4c-4b2e-8aaf-6213e1f0468b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:01.692506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:01.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 155/325] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:01.695794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.731065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.731775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.732109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.732450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.733600 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.735228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.736800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 171/326] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:01.737546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.781272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.799992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88fd4-ac81-44b1-a5ef-74e29415f06f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.831261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.834218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.834885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.835140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.835426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.837378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b92b8-d04a-44f5-b381-3813b1185d6b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.848947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:01.854032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:01.854938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 156/327] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:01.856632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.872396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.873002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.873270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.873535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.874234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:01.874551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.875930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.883989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 172/328] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:01.884699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.961262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacfd3-2c20-4e5c-bf38-ea06dca8ca01 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.981729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba350-4bf6-4a2e-abf5-c5d08d7f6c1d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.993835 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792326-a905-453c-ba8d-35829329a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.994538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792326-a905-453c-ba8d-35829329a224 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.994822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792326-a905-453c-ba8d-35829329a224 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.995092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792326-a905-453c-ba8d-35829329a224 None admin] PATH_INFO: `/v3/groups` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.995715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792326-a905-453c-ba8d-35829329a224 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.997163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792326-a905-453c-ba8d-35829329a224 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:02.013613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 157/329] 10.222.0.75 () {60 vars in 1134 bytes} [Wed Aug 31 10:41:01 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:02.014533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792326-a905-453c-ba8d-35829329a224 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:02.015461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:02.016200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.016494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.016759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.017184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:02.017430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:02.017726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:02.019363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:02.030357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 173/330] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:02.036313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:02.061279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:02.142766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792326-a905-453c-ba8d-35829329a224 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:02.148944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b6aa-e04e-425b-8d19-65093d60af2c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:02.182974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:02.183629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.183939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.184210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] PATH_INFO: `/v3/users/ea3b6aee0cc54f7cb09077dfc96f1c3c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.185372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3b6aee0cc54f7cb09077dfc96f1c3c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:02.186874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:02.188860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 158/331] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:02 2022] GET /identity/v3/users/ea3b6aee0cc54f7cb09077dfc96f1c3c => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:02.191667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:02.192301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.192570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.192837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] PATH_INFO: `/v3/users/cddb9b60b9b441458b3533efb00cbc65` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.193971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] RBAC: Authorizing `identity:get_user(user_id=cddb9b60b9b441458b3533efb00cbc65)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:02.195316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:02.195443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:02.197203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 174/332] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:02 2022] GET /identity/v3/users/cddb9b60b9b441458b3533efb00cbc65 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:02.203469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:02.279081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:02.315547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:02.320839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b86477-2e24-4d4b-9a6d-1c403c0522b8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:02.334941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325479e-0717-44fe-ba67-2d7905c3b728 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:02.362164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:02.362807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.363085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.363351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.364238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] RBAC: Adding query filter params (role.id=8d8fadd4e1414e3da426c068de39430b, user.id=ea3b6aee0cc54f7cb09077dfc96f1c3c, scope.system=all) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:02.364539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:02.366639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3722-bd70-4ed5-acf9-fc064b15d1d5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:02.375826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a48db-2904-4685-a6e9-7198fee23468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:02.376491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a48db-2904-4685-a6e9-7198fee23468 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.376766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a48db-2904-4685-a6e9-7198fee23468 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.377037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a48db-2904-4685-a6e9-7198fee23468 None admin] PATH_INFO: `/v3/system/users/cddb9b60b9b441458b3533efb00cbc65/roles/cde012161d59480cb7d2d8bd7c10763e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.378503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a48db-2904-4685-a6e9-7198fee23468 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cddb9b60b9b441458b3533efb00cbc65, role_id=cde012161d59480cb7d2d8bd7c10763e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:02.379885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a48db-2904-4685-a6e9-7198fee23468 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:02.381165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 159/333] 10.222.0.75 () {56 vars in 1308 bytes} [Wed Aug 31 10:41:02 2022] GET /identity/v3/role_assignments?user.id=ea3b6aee0cc54f7cb09077dfc96f1c3c&scope.system=all&role.id=8d8fadd4e1414e3da426c068de39430b => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:02.392421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 175/334] 10.222.0.75 () {58 vars in 1334 bytes} [Wed Aug 31 10:41:02 2022] PUT /identity/v3/system/users/cddb9b60b9b441458b3533efb00cbc65/roles/cde012161d59480cb7d2d8bd7c10763e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:04.443582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd79b-31dd-4fd1-8d57-98424957c99b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.444625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd79b-31dd-4fd1-8d57-98424957c99b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.445105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd79b-31dd-4fd1-8d57-98424957c99b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.447079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 160/335] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:04.452110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7308-8740-4c4d-9533-321ebb4a8d34 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.453039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7308-8740-4c4d-9533-321ebb4a8d34 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.453543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7308-8740-4c4d-9533-321ebb4a8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.476861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d9ebd-c2fc-4368-bcfe-9823ea4519e6 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.477475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d9ebd-c2fc-4368-bcfe-9823ea4519e6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.477959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d9ebd-c2fc-4368-bcfe-9823ea4519e6 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.478087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-30be7308-8740-4c4d-9533-321ebb4a8d34 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:04.479308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-30be7308-8740-4c4d-9533-321ebb4a8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:04.480276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 161/336] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:04.486939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f441ade-7d0a-4973-b644-98d65c71dbb5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.487500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f441ade-7d0a-4973-b644-98d65c71dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.487998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f441ade-7d0a-4973-b644-98d65c71dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.521124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9f441ade-7d0a-4973-b644-98d65c71dbb5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:04.522707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9f441ade-7d0a-4973-b644-98d65c71dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:04.610991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 176/337] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:04.627998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 162/338] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:04.808317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be30e23-0d40-4465-87a8-2bcee01a3190 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.808972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be30e23-0d40-4465-87a8-2bcee01a3190 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.809464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be30e23-0d40-4465-87a8-2bcee01a3190 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.811172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 177/339] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:04.825078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.825887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.826379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.851054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:04.852298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:04.920120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:04.942472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 163/340] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:05.024740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be30e23-0d40-4465-87a8-2bcee01a3190 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.094671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.150919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:05.193438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be30e23-0d40-4465-87a8-2bcee01a3190 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:05.221357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890482b6-4a78-42fd-a1eb-adf4270732e9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:05.262052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8627-f47f-4ae5-91c8-b4fc7c26dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:05.263213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8627-f47f-4ae5-91c8-b4fc7c26dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.263669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8627-f47f-4ae5-91c8-b4fc7c26dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.264307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8627-f47f-4ae5-91c8-b4fc7c26dbc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.274808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fd49b-0175-479e-bf0a-f7ea92723bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:05.275461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fd49b-0175-479e-bf0a-f7ea92723bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.275974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fd49b-0175-479e-bf0a-f7ea92723bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.276395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d8627-f47f-4ae5-91c8-b4fc7c26dbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:05.276510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fd49b-0175-479e-bf0a-f7ea92723bd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-908d8627-f47f-4ae5-91c8-b4fc7c26dbc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:05.281809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:05.282822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:05.283802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:05.286324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 164/341] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:05.287809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230f34-d73f-4ac4-8fef-47400cb8afeb None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.288243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230f34-d73f-4ac4-8fef-47400cb8afeb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.288657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230f34-d73f-4ac4-8fef-47400cb8afeb None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.290631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 165/342] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:05.297002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230f34-d73f-4ac4-8fef-47400cb8afeb None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.314785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fd49b-0175-479e-bf0a-f7ea92723bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1e0fd49b-0175-479e-bf0a-f7ea92723bd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:05.319825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:05.320734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:05.321513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 178/343] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:05.322683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.322811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.325792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.351930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:05.353032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:05.398131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:05.433723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 179/344] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:05.438396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.456388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230f34-d73f-4ac4-8fef-47400cb8afeb None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:05.499944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:05.501153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.501619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.502113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.502989 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:05.503491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:05.505093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:05.514920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 166/345] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:05.516675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.606371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:05.630928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8877-db7e-4663-b183-0026c79ff375 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:05.649553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5587c0-c786-4b32-93ab-0d6ff7b82733 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:05.655155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:05.671436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:05.672237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.672703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.673096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.685501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:05.690907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:05.691815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:05.692707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:05.693872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 167/346] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:05.694049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.726497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:05.727172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.727606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.728016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.728849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:05.729278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:05.730836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:05.748502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 180/347] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:05.749575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.805514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f00b-8106-4112-b61d-e94e89c04142 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:05.844202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:05.845126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.845537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.845965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.890222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:05.918667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:05.920786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:05.976301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc0be0-1f9e-4d28-93de-a9719e829c7b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.026010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.026632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.026913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.027182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.027846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:06.028337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.029708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15e76b-395d-41c4-b8c0-633d2247da7d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.031327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 168/348] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:06.031558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.032318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.042705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 181/349] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:06.044166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2016a-a086-474f-b54a-63ef634f7f33 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.044580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2016a-a086-474f-b54a-63ef634f7f33 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.045473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2016a-a086-474f-b54a-63ef634f7f33 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.046944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 182/350] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:06.047878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2016a-a086-474f-b54a-63ef634f7f33 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.136543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.179654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b6c9-2e20-4710-b16e-35413edf7f5d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.191824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2016a-a086-474f-b54a-63ef634f7f33 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.223686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.224600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.224881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.225154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.229580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.230273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.230529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.230789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.245837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:06.251214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:06.252105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:41:06.252888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:06.255213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 183/351] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:06.256437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.321090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.322940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.329986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.392840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc326d-b2cd-4719-ae6c-c61c99415e52 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.401430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.445486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb89e-ee04-42e0-85e3-051d4ca30bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.446530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb89e-ee04-42e0-85e3-051d4ca30bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.446995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb89e-ee04-42e0-85e3-051d4ca30bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.447433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb89e-ee04-42e0-85e3-051d4ca30bd8 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.448679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eb89e-ee04-42e0-85e3-051d4ca30bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.449285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 169/352] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:06.450186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eb89e-ee04-42e0-85e3-051d4ca30bd8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.450418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.452120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 184/353] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:06.453645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.454155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.455502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.477650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:06.479711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:06.555867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 185/354] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:06.556638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.576892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275b30e-6941-43b0-a40e-618534d6d948 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.623800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.625243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.626037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.626500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.627249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.674179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.693403 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71212555-f071-48bc-9289-ad813f6e2acc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.723439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.725209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.741445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.742321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.742777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.743246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.744179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:06.744741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.746312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.756594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 186/355] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:06.757735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.851571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 170/356] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:06.852618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.879134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24313-4623-436d-951e-faafb39a7e45 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.899079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.919364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78431c2-4fbe-414a-b2bd-c4ddf7e89cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.920133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78431c2-4fbe-414a-b2bd-c4ddf7e89cad None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.920571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78431c2-4fbe-414a-b2bd-c4ddf7e89cad None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.920834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78431c2-4fbe-414a-b2bd-c4ddf7e89cad None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.922053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78431c2-4fbe-414a-b2bd-c4ddf7e89cad None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.923586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78431c2-4fbe-414a-b2bd-c4ddf7e89cad None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.925597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 187/357] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:06.927593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f562-0adc-41fe-9cf8-98836418ca61 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.927781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f562-0adc-41fe-9cf8-98836418ca61 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.928017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f562-0adc-41fe-9cf8-98836418ca61 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.929353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 188/358] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:06.929927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f562-0adc-41fe-9cf8-98836418ca61 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.943026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.979066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab6783-4668-449f-944a-b78a51f9eca3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.021246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.021962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.022242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.022509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.029292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.030523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.032560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 171/359] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.033569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.066791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f562-0adc-41fe-9cf8-98836418ca61 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.107819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.108725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.109004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.109274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] PATH_INFO: `/v3/users/cddb9b60b9b441458b3533efb00cbc65` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.110497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] RBAC: Authorizing `identity:get_user(user_id=cddb9b60b9b441458b3533efb00cbc65)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.111952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.113559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 189/360] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/users/cddb9b60b9b441458b3533efb00cbc65 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.115388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.148664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bd0f4-7979-4d17-8ec4-aeefdab5c7aa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.173354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.186112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ae0-4f04-47f1-b70f-b0ceb8f75425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.186816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ae0-4f04-47f1-b70f-b0ceb8f75425 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.187095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ae0-4f04-47f1-b70f-b0ceb8f75425 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.187418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ae0-4f04-47f1-b70f-b0ceb8f75425 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.189345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.199837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ae0-4f04-47f1-b70f-b0ceb8f75425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-5c6d9ae0-4f04-47f1-b70f-b0ceb8f75425 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:07.205381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:07.206506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:07.207495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:07.211614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 172/361] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:07.212956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.213235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.213515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.232159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:07.233330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:07.239695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e3a9-c956-4aca-b3fc-33d2f491ee10 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.277110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.278117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.278117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.278314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.280485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.282034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.283870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 190/362] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.286238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.314727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 173/363] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:07.315876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.413014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0cd63-9426-4ea7-bd0a-e28b389703fd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.439644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.446104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca17bf8-e9ca-4597-9b6c-bb4c953011dd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.459270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.460261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.460547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.460807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.462613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.464323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.465946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 191/364] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.466727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.481338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.496965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.498018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.498497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.498964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.499868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=248b025f240a476dadac1c918e685632) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.500365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.502333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.510455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 174/365] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=248b025f240a476dadac1c918e685632&role.id=82cfaa1d7baa4067892940a470beb46e => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.511354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.607828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f387-24df-481c-84bf-7edb1f9c9a2d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.640157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94933ff-09ce-454e-b254-bf2b83d8ea6c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.655578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.656210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.656648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.656958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.657701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] RBAC: Adding query filter params (role.id=cde012161d59480cb7d2d8bd7c10763e, user.id=cddb9b60b9b441458b3533efb00cbc65, scope.system=all) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.660454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.662204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.680417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 192/366] 10.222.0.75 () {56 vars in 1308 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/role_assignments?user.id=cddb9b60b9b441458b3533efb00cbc65&scope.system=all&role.id=cde012161d59480cb7d2d8bd7c10763e => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.681434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.690118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.691055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.691539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.691984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.692870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.693180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.694972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.707005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 175/367] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.708225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.754853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.785184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.836794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4e6e5-459d-4239-bc2e-8bc34f415805 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.866102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eb1cc-c3f6-475c-9f5f-7f6185dd9fa9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.886021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.886806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.887088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.887359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.889154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.890668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.892599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 193/368] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.893299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.916428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.917456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.917957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.918414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.919380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=248b025f240a476dadac1c918e685632) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.919894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.921361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.930285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 176/369] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=248b025f240a476dadac1c918e685632&role.id=8d8fadd4e1414e3da426c068de39430b => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.931917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.044281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8ab84-5524-45cb-b6be-0d15c31522a3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.064605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.078806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a75d8a-ec2e-47de-83df-b9f7835a49b9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.097286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.097723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.098065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.098345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.098976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.112380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:08.119794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:08.120849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:08.121620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 194/370] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:08.122751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.131990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.132948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.133437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.134290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.212282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.214435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.245976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5e89-7048-4cc2-8ba2-2c4eaa539dfc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.297705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.298879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.300488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.300953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.301937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.302450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.304127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.312147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 195/371] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=8d8fadd4e1414e3da426c068de39430b => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:08.313490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.367645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 177/372] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:08.375281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.398180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.405804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.520510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951b1d7-593f-4eb2-bce3-4a87b7cecd8e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.551763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35a5d-98e0-4380-8622-74ec5c1e9ec4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.580603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.582029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.582425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.583278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.583718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.586069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.606180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 196/373] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:08.614837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.626652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.627323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.627604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.627880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.629111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.630600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.633544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 178/374] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:08.638220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.728759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fd781-b957-4cb0-a33a-9983a372c015 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.742209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.763310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.783439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677062b5-95e6-48a6-8060-02f09f96749d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.791793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.792439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.792711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.792987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.819625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.820244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.820525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.820794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.822004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.823479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.829926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 179/375] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:08.831659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.949317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d769d2-5c16-48e5-9c64-bc2ff619b1d3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.970798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.972277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.990847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.991482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.992207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.992486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.993523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.993887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.995349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.005937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 180/376] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=82cfaa1d7baa4067892940a470beb46e => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.132544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.141956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 197/377] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:41:09.142744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.175990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.288036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b902-e1df-48cc-a39e-810c5d47731c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.339368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.340016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.340295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.340565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] PATH_INFO: `/v3/projects/5efb11cead144cc7a5078ee4532b8260` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.341694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] RBAC: Authorizing `identity:get_project(project_id=5efb11cead144cc7a5078ee4532b8260)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.343181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.345189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 181/378] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/projects/5efb11cead144cc7a5078ee4532b8260 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:09.351959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.476665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fd31-a720-4adf-8ca2-004ca43674d1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.510191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695d61-63e1-410a-a68b-7ea872da5867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.510836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695d61-63e1-410a-a68b-7ea872da5867 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.511101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695d61-63e1-410a-a68b-7ea872da5867 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.511369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695d61-63e1-410a-a68b-7ea872da5867 None admin] PATH_INFO: `/v3/groups/67f1f7f689854587aeefd5a8ec50a8cf` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.517353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695d61-63e1-410a-a68b-7ea872da5867 None admin] RBAC: Authorizing `identity:get_group(group_id=67f1f7f689854587aeefd5a8ec50a8cf)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.518818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695d61-63e1-410a-a68b-7ea872da5867 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.520750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 198/379] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/groups/67f1f7f689854587aeefd5a8ec50a8cf => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.530870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.638123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.661334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5ec8-f980-45a1-98c8-b2b00e1f9968 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.711289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.711911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.712191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.712466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.713201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] RBAC: Adding query filter params (group.id=67f1f7f689854587aeefd5a8ec50a8cf, role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=5efb11cead144cc7a5078ee4532b8260) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:09.713506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.715072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80eeb3-a0ee-45e9-aa2d-41917883ee98 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.726481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 182/380] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/role_assignments?group.id=67f1f7f689854587aeefd5a8ec50a8cf&scope.project.id=5efb11cead144cc7a5078ee4532b8260&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.956350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e090-3527-40d7-b7f1-51fb83452b37 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.956897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e090-3527-40d7-b7f1-51fb83452b37 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.956897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e090-3527-40d7-b7f1-51fb83452b37 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.958440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 199/381] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:09.964150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6894-d896-4fc4-98a8-22e97c572c14 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.964678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6894-d896-4fc4-98a8-22e97c572c14 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.964678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6894-d896-4fc4-98a8-22e97c572c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.983499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1abf6894-d896-4fc4-98a8-22e97c572c14 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:09.984703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1abf6894-d896-4fc4-98a8-22e97c572c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:10.061927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 183/382] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:10.184587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29a9a-b9d3-4677-b2cc-996f271583e8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.184940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29a9a-b9d3-4677-b2cc-996f271583e8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.185120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29a9a-b9d3-4677-b2cc-996f271583e8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.186726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 200/383] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:10.192108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.192403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.192677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.222814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:10.224054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:10.309524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 184/384] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:10.502798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a29a9a-b9d3-4677-b2cc-996f271583e8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:10.581811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:10.636476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a29a9a-b9d3-4677-b2cc-996f271583e8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:10.665827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:10.674588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:10.689743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50d894-1f84-41d5-85bd-074f22bcd3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:10.690424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50d894-1f84-41d5-85bd-074f22bcd3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.691146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50d894-1f84-41d5-85bd-074f22bcd3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.691420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50d894-1f84-41d5-85bd-074f22bcd3a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.706753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50d894-1f84-41d5-85bd-074f22bcd3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1d50d894-1f84-41d5-85bd-074f22bcd3a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:10.713827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:10.715010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:10.715899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 201/385] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:10.716665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0648-9eb0-4ffc-b272-546b5d26ead7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.716947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0648-9eb0-4ffc-b272-546b5d26ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.717220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0648-9eb0-4ffc-b272-546b5d26ead7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.718511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 202/386] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:10.721573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0648-9eb0-4ffc-b272-546b5d26ead7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:10.802364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753a17-53a1-4d39-a5ed-2c4195bfe1e4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:10.839574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3166f5a-c511-4ddf-b5ee-b0f0d9adcd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:10.840257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3166f5a-c511-4ddf-b5ee-b0f0d9adcd7a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.840542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3166f5a-c511-4ddf-b5ee-b0f0d9adcd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.840812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3166f5a-c511-4ddf-b5ee-b0f0d9adcd7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.852614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3166f5a-c511-4ddf-b5ee-b0f0d9adcd7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:10.853470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0648-9eb0-4ffc-b272-546b5d26ead7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d3166f5a-c511-4ddf-b5ee-b0f0d9adcd7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:10.857682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:10.858631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:10.859417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 185/387] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:10.866622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.866622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.866622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.879254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:10.880452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:10.890375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:10.904142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:10.905145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.905640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.906203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.907133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:10.907629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:10.909271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:10.924778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 203/388] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:10.926619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:10.950247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:10.954336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 186/389] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:10.955080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.031717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e870-3d3a-41a3-9df2-51a692b16fc8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.077315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.077884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.078158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.078419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.079088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:11.079671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.081102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.102755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 204/390] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:11.108670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.147959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5c46-090d-48f0-8cce-40e20f747637 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.204056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.204707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.204814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.205015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.205274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.207008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.207975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.210117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 187/391] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:10 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:11.217411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.302900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421469df-db6d-422c-b160-de63e0a26893 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.328102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.338017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.339000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.339475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.339940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.341257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.343053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.345239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 205/392] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:11.350711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.366421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cdfb4-9415-45db-973a-d22a43abf288 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.411187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.412461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.412906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.413316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.415130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.417024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.420191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 188/393] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:11.421113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.472229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d44ef-0463-4e15-94f2-c4cdba61fc87 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.489395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.509582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.510354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.510628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.511015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.522350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:11.525458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b908f1-6906-444e-9763-57c1ed0c7d85 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:11.527981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:11.529046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:11.529883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 206/394] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:11.530535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.564555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.570580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83165dfd-8b5c-4924-97f3-18ceed980de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.571221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83165dfd-8b5c-4924-97f3-18ceed980de0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.571497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83165dfd-8b5c-4924-97f3-18ceed980de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.571766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83165dfd-8b5c-4924-97f3-18ceed980de0 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.572882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83165dfd-8b5c-4924-97f3-18ceed980de0 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.574367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83165dfd-8b5c-4924-97f3-18ceed980de0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.576007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 189/395] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:11.577116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e282-8168-420c-9703-a7b53bfed730 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.577396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e282-8168-420c-9703-a7b53bfed730 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.577665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e282-8168-420c-9703-a7b53bfed730 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.578916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 190/396] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:11.579612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753e282-8168-420c-9703-a7b53bfed730 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.643618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614671d-8e70-483e-83b1-b47b8872dcdc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.679415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.680095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.680370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.680639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632/groups/30cd325d704c4418918f890a64ef4a5b/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.682911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=248b025f240a476dadac1c918e685632, group_id=30cd325d704c4418918f890a64ef4a5b, role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.684401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.696001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753e282-8168-420c-9703-a7b53bfed730 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.698531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 207/397] 10.222.0.75 () {58 vars in 1442 bytes} [Wed Aug 31 10:41:11 2022] PUT /identity/v3/projects/248b025f240a476dadac1c918e685632/groups/30cd325d704c4418918f890a64ef4a5b/roles/82cfaa1d7baa4067892940a470beb46e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:11.710813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.737320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.738353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.738901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.739358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.740293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:11.740821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.742510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a711-eabf-4a70-a809-ed47d4697a62 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.753961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 191/398] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:11.755659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.756208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.756713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.769476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.783158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:11.785158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:11.848766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65cab-57f2-42ea-b95e-a192cf6dd8c2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.865741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.879979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 192/399] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:11.881319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.895796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175257e-9050-4cdd-a916-282bdc2d2d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.896551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175257e-9050-4cdd-a916-282bdc2d2d00 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.896890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175257e-9050-4cdd-a916-282bdc2d2d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.897226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175257e-9050-4cdd-a916-282bdc2d2d00 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632/groups/30cd325d704c4418918f890a64ef4a5b/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.899263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175257e-9050-4cdd-a916-282bdc2d2d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=248b025f240a476dadac1c918e685632, group_id=30cd325d704c4418918f890a64ef4a5b, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.900949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175257e-9050-4cdd-a916-282bdc2d2d00 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.918734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 208/400] 10.222.0.75 () {58 vars in 1442 bytes} [Wed Aug 31 10:41:11 2022] PUT /identity/v3/projects/248b025f240a476dadac1c918e685632/groups/30cd325d704c4418918f890a64ef4a5b/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:12.032475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b392-c95a-4760-847d-3e49133d3fd5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.059472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b5d4-4b02-4c47-b71e-5ab2dca54dec None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.060052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b5d4-4b02-4c47-b71e-5ab2dca54dec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.060052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55b5d4-4b02-4c47-b71e-5ab2dca54dec None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.061704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 209/401] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:12.067503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.067791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.068250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.084349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.085405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.085941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.086459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.087832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.089925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.092253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 193/402] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:12.099245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.103291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:12.105542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:12.185344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.198762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 210/403] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:12.200204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.247265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.303847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b212bab-0625-4baa-bc8d-52872ad1f8d8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.307742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e656-8034-4e44-9553-ffe8789b4d37 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.343388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.344041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.344308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.344567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.358637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:12.364073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:12.364994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:12.365846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 211/404] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:12.374653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.401630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.402298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.402571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.402839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.403956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.405395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.407055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 194/405] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:12.418176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.466778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.486759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223c97-b905-4850-8edd-1de2806304f1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.528406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.529904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.530480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.530927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.531924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:12.532764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.534784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.546202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 212/406] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:12.547337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.581367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5cf6-82eb-4ea8-8a46-09e25519115c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.613850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.626093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.627098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.627525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.627943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/groups/30cd325d704c4418918f890a64ef4a5b/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.630865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] RBAC: Authorizing `identity:create_grant(project_id=5f30f0ced3f84e0fbf1b5e4614734b35, group_id=30cd325d704c4418918f890a64ef4a5b, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.633013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.652497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 195/407] 10.222.0.75 () {58 vars in 1442 bytes} [Wed Aug 31 10:41:12 2022] PUT /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/groups/30cd325d704c4418918f890a64ef4a5b/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:12.653551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.686116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18696f66-9d2b-4bc1-b940-64ddc985fb18 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.755478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.756372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.756740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.757108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.779582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2435d6d-c538-468c-b79b-e46190a6b0ce None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.784733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:12.790524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:12.791706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:12.792668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:12.794593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 213/408] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:12.800680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.812681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.834296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.835348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.835786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.836510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.838136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.840519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.846051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 196/409] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:12.851715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.933166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366df18-30f8-4107-9c3b-2afcc85766be None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.933571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.970527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.971601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.972101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.972573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.973454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:12.973982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.975586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.981570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63e49-50a0-45b3-bde5-b8ab28a3563e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.985496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 214/410] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:12.991621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.016949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.017691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.018416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.018416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.019493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.020948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.024103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 197/411] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:13.029657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.069226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:13.105866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97cf9f-cfd3-4ae7-8f6c-9e5cb724f896 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.136966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469763a-43fa-4479-89dd-6ca0a2a05528 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.149323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.150324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.151044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.151947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] PATH_INFO: `/v3/groups/67f1f7f689854587aeefd5a8ec50a8cf` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.153560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] RBAC: Authorizing `identity:get_group(group_id=67f1f7f689854587aeefd5a8ec50a8cf)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.155924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.158422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 215/412] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/groups/67f1f7f689854587aeefd5a8ec50a8cf => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:13.168605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:13.169061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.194309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.194309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.194309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.194309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/groups/30cd325d704c4418918f890a64ef4a5b/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.195066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f30f0ced3f84e0fbf1b5e4614734b35, group_id=30cd325d704c4418918f890a64ef4a5b, role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.195066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.207655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 198/413] 10.222.0.75 () {58 vars in 1442 bytes} [Wed Aug 31 10:41:13 2022] PUT /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35/groups/30cd325d704c4418918f890a64ef4a5b/roles/82cfaa1d7baa4067892940a470beb46e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:41:13.332563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5789-2127-478e-873d-c3a74b16481c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.369862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e7d96-4c48-4d1a-9461-b40c0a8b8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.370941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e7d96-4c48-4d1a-9461-b40c0a8b8e8d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.371416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e7d96-4c48-4d1a-9461-b40c0a8b8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.371908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e7d96-4c48-4d1a-9461-b40c0a8b8e8d None admin] PATH_INFO: `/v3/projects/5efb11cead144cc7a5078ee4532b8260` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.373374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e7d96-4c48-4d1a-9461-b40c0a8b8e8d None admin] RBAC: Authorizing `identity:get_project(project_id=5efb11cead144cc7a5078ee4532b8260)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.375209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e7d96-4c48-4d1a-9461-b40c0a8b8e8d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.377657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 216/414] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:13 2022] GET /identity/v3/projects/5efb11cead144cc7a5078ee4532b8260 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:13.385816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.502597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de130d7c-a2bf-48c7-b082-7fb51ea751a6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.537610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c1ab2-f6fa-4dbd-b903-263d327dcf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.538319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c1ab2-f6fa-4dbd-b903-263d327dcf1c None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.538598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c1ab2-f6fa-4dbd-b903-263d327dcf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.538870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c1ab2-f6fa-4dbd-b903-263d327dcf1c None admin] PATH_INFO: `/v3/projects/5efb11cead144cc7a5078ee4532b8260/groups/67f1f7f689854587aeefd5a8ec50a8cf/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.540793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c1ab2-f6fa-4dbd-b903-263d327dcf1c None admin] RBAC: Authorizing `identity:create_grant(project_id=5efb11cead144cc7a5078ee4532b8260, group_id=67f1f7f689854587aeefd5a8ec50a8cf, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.542290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c1ab2-f6fa-4dbd-b903-263d327dcf1c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.558302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 199/415] 10.222.0.75 () {58 vars in 1442 bytes} [Wed Aug 31 10:41:13 2022] PUT /identity/v3/projects/5efb11cead144cc7a5078ee4532b8260/groups/67f1f7f689854587aeefd5a8ec50a8cf/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:14.154166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00efce-3606-4479-9f6a-b2d587b8a262 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:14.154676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00efce-3606-4479-9f6a-b2d587b8a262 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:14.154676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00efce-3606-4479-9f6a-b2d587b8a262 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:14.156253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 217/416] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:14.161445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ebc91-c9d4-464c-9248-ba8271068927 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:14.161731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ebc91-c9d4-464c-9248-ba8271068927 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:14.162032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ebc91-c9d4-464c-9248-ba8271068927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:14.186773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ef8ebc91-c9d4-464c-9248-ba8271068927 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:14.188035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ef8ebc91-c9d4-464c-9248-ba8271068927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:14.230073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:14.262330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 200/417] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:14.272457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc753b-3c3f-462b-b3a0-324f967aaa6a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:14.272736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc753b-3c3f-462b-b3a0-324f967aaa6a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:14.272987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc753b-3c3f-462b-b3a0-324f967aaa6a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:14.274616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 218/418] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:14.280746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:14.281036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:14.281305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:14.300991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:14.302313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:14.370518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 201/419] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:14.671083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc753b-3c3f-462b-b3a0-324f967aaa6a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:14.681200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:14.743270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:14.822564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc753b-3c3f-462b-b3a0-324f967aaa6a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:14.871075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d207c5-8cec-49da-9214-77e2378e3f26 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:14.873917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:14.879277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:14.880639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:14.880911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:14.881172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:14.910698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:14.911344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:14.911623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:14.911893 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:14.913355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:14.918653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:14.919519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:14.920323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 219/420] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:14.923095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:14.928525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:14.930668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:14.932534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 202/421] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:14.934084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:14.935416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.047359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fd8e-d746-4782-925d-9763577e9f80 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.070626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.086558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.087178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.087492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.087764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.088424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:15.088717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.090666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.100552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 203/422] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:15.107163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.149576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61669a40-5937-49cd-9f2d-9db482ab2085 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.168224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.203686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.204999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.205447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.205925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.206801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:15.207273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.209711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.224754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 220/423] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:15.231166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.296415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e5ab5-77e4-4914-a739-1005cbdf9cb7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.339711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44a773-7879-4d13-8a97-3ff2950e7a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.340568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a773-7879-4d13-8a97-3ff2950e7a80 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.340843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a773-7879-4d13-8a97-3ff2950e7a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.342013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44a773-7879-4d13-8a97-3ff2950e7a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.381363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8911e-4c4b-49da-86d1-d8c0a6481cf6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.413253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.427283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d56d1-dedd-4278-a834-72d87a38fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.427283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d56d1-dedd-4278-a834-72d87a38fc88 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.427283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d56d1-dedd-4278-a834-72d87a38fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.427283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d56d1-dedd-4278-a834-72d87a38fc88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.429904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44a773-7879-4d13-8a97-3ff2950e7a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.432434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44a773-7879-4d13-8a97-3ff2950e7a80 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.467257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.513911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d56d1-dedd-4278-a834-72d87a38fc88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.515400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d56d1-dedd-4278-a834-72d87a38fc88 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.547916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 204/424] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:15.554223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04418e-d863-4f12-b6c6-fac850c555bd None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.554507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04418e-d863-4f12-b6c6-fac850c555bd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.554781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04418e-d863-4f12-b6c6-fac850c555bd None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.557825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 205/425] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:15.557825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcdb39-59e3-4420-8ce2-3dd040e31762 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.557825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcdb39-59e3-4420-8ce2-3dd040e31762 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.557825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcdb39-59e3-4420-8ce2-3dd040e31762 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.559025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 206/426] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:15.560908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcdb39-59e3-4420-8ce2-3dd040e31762 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.626451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 221/427] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:15.627793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.628065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.628328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.646105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:15.647290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:15.672736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.676385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcdb39-59e3-4420-8ce2-3dd040e31762 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.701904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.712136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a692d11-4fd4-440c-bad9-16bb4b56727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.712779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a692d11-4fd4-440c-bad9-16bb4b56727e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.713056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a692d11-4fd4-440c-bad9-16bb4b56727e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.713325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a692d11-4fd4-440c-bad9-16bb4b56727e None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.715197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a692d11-4fd4-440c-bad9-16bb4b56727e None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.716667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a692d11-4fd4-440c-bad9-16bb4b56727e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.718464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 207/428] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:15.719645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.719922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.720189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.730385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 222/429] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:15.731413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.744034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:15.745238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:15.829475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 208/430] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:15.830865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.887066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0042cc3-5679-4533-8fb4-1ac0e4aed67e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.937988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d681-3eae-4d18-bbe6-c43f266fb52e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.955101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.955764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.956038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.956306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] PATH_INFO: `/v3/projects/248b025f240a476dadac1c918e685632` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.962467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] RBAC: Authorizing `identity:get_project(project_id=248b025f240a476dadac1c918e685632)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.963923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.964666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.965966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 223/431] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/projects/248b025f240a476dadac1c918e685632 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:15.971447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.978993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2d90e-e674-43f1-b2f2-5a7f71a32113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.979934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2d90e-e674-43f1-b2f2-5a7f71a32113 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.980429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2d90e-e674-43f1-b2f2-5a7f71a32113 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.980884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2d90e-e674-43f1-b2f2-5a7f71a32113 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.982297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2d90e-e674-43f1-b2f2-5a7f71a32113 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.984091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2d90e-e674-43f1-b2f2-5a7f71a32113 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.986443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 209/432] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:15.987938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883a94d-1440-4789-9be5-ecfec5caf0e5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.988411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883a94d-1440-4789-9be5-ecfec5caf0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.988945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883a94d-1440-4789-9be5-ecfec5caf0e5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.990650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 210/433] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:15.998747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883a94d-1440-4789-9be5-ecfec5caf0e5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.009721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.087343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990d69-d74c-45e8-8ba9-1eaf909904e4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.108275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883a94d-1440-4789-9be5-ecfec5caf0e5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.121570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1321a-4e6e-4d45-8dc6-6d06e8cdc9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.122165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1321a-4e6e-4d45-8dc6-6d06e8cdc9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.122437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1321a-4e6e-4d45-8dc6-6d06e8cdc9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.122705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1321a-4e6e-4d45-8dc6-6d06e8cdc9b1 None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.123810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1321a-4e6e-4d45-8dc6-6d06e8cdc9b1 None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.125252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1321a-4e6e-4d45-8dc6-6d06e8cdc9b1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.127326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 224/434] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:16.128448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.128448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.128619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.145686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.146245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:16.146365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.146633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.146899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.147408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:16.147665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=248b025f240a476dadac1c918e685632) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.147964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.149586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.161801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 211/435] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=248b025f240a476dadac1c918e685632&role.id=8d8fadd4e1414e3da426c068de39430b => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:16.161801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.223481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 225/436] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:16.224210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.244524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.265529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.297231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69a91-d287-4e17-994c-993de93e9cfa None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.342238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.342881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.343157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.343425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.359478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:16.359661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f80ca-9837-4f6d-86a8-a468578da8f9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:16.365250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:16.366247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:16.367085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 212/437] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:16.367714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.406339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.407316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.408503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.408778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.409562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=248b025f240a476dadac1c918e685632) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.409886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.411460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.419132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 226/438] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=248b025f240a476dadac1c918e685632&role.id=82cfaa1d7baa4067892940a470beb46e => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:16.419779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.520169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c4366-d0fa-439c-b9b9-a29a60ba48ef None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.534948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.542684 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.553615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b651-a109-4d89-adc6-190bcc38b6a9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.578730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.579805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.579805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.579805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.595787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:16.601193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:16.602184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:16.602961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:16.603539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.604102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.604102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.604275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 213/439] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:16.604868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.606108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.607003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.607614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.609284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.619225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 227/440] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:16.620356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.728111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257380f-d945-471d-a9fb-4ae50d1de435 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.734052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd75e-afbe-4ebd-bd6e-a137593f8432 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.768179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.768831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.769110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.769382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.775415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.775975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.776246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.776513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.777173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.777470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.779007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.782792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:16.787368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:16.788219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:16.789004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 214/441] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:16.789656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.791736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 228/442] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:16.797256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.815390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.836544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.900278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f72e-41a0-4286-92ae-b79c78560b8e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.903477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989291-a313-45a0-87b7-57bb72082168 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.939813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.940470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.940772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.941047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.944741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.945376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.945648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.945961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.946640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.946939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.948315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.956561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 229/443] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:16.957535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.007684 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.009187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.032114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.043257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.058122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178432-5875-408b-8bf9-e63b86745bb4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.092493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.093110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.093388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.093650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.107742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 215/444] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:17.108622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.165585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.167063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.204512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54dd20-c1bf-4972-b00c-40c8878b8444 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.236835 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.237428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.237697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.237991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.238454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.242733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.264905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 230/445] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:17.266081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.310200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.311635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.364485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d3609-b6ed-42f5-964b-a7ac07d9b9d7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.398453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.399064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.399338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.399620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.400746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.402227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.403841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 231/446] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.404600 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.417788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 216/447] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:17.418753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.449855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.452281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.505385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ebaf-6890-4891-b782-ac097987c1af None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.517051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34eae-8084-462f-b7b9-fc5abfd4b33b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.538384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.539021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.539294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.539528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] PATH_INFO: `/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.540631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] RBAC: Authorizing `identity:get_project(project_id=5f30f0ced3f84e0fbf1b5e4614734b35)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.542110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.543761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 232/448] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/projects/5f30f0ced3f84e0fbf1b5e4614734b35 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.544542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.552177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.552809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.553082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.553349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.554502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.555946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.557519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 217/449] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.558316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.651261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669baf1-7cbf-4c00-a476-bb614c81b8fc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.659021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff488e1-5648-4a87-915d-82e83a0be56d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.661311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.662484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.685478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.686151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.686423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.686688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] PATH_INFO: `/v3/projects/5efb11cead144cc7a5078ee4532b8260` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.687839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=5efb11cead144cc7a5078ee4532b8260)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.689304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.691030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 233/450] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/projects/5efb11cead144cc7a5078ee4532b8260 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.691781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.697067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.697732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.698043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.698341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] PATH_INFO: `/v3/groups/30cd325d704c4418918f890a64ef4a5b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.699438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] RBAC: Authorizing `identity:get_group(group_id=30cd325d704c4418918f890a64ef4a5b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.700913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.702505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 218/451] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/groups/30cd325d704c4418918f890a64ef4a5b => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.703252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.791654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9cc1b-c9af-4880-a998-a7cae3402ba5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.802653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2728c64-8551-46f0-95f7-205ed266e8db None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.825625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.828887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.828887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.828887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.828887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=8d8fadd4e1414e3da426c068de39430b, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:17.828887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.829360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.835702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 234/452] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=8d8fadd4e1414e3da426c068de39430b => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.836496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.840591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.841279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.841576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.841920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] PATH_INFO: `/v3/groups/67f1f7f689854587aeefd5a8ec50a8cf` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.843522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] RBAC: Authorizing `identity:get_group(group_id=67f1f7f689854587aeefd5a8ec50a8cf)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.845548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.847417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 219/453] 10.222.0.75 () {56 vars in 1180 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/groups/67f1f7f689854587aeefd5a8ec50a8cf => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.853580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.899275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.904105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.965580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab140d9-9b22-47d9-935f-62405483583c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.972198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2e63-b100-4679-83ac-7931fcf19374 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:18.012367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:18.012576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:18.013039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:18.013232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:18.013324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:18.013508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:18.013603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:18.013826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:18.017635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] RBAC: Adding query filter params (group.id=67f1f7f689854587aeefd5a8ec50a8cf, role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=5efb11cead144cc7a5078ee4532b8260) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:18.017805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] RBAC: Adding query filter params (group.id=30cd325d704c4418918f890a64ef4a5b, role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:18.017889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:18.017979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:18.018049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3876e-a886-4eb5-82ec-dd3074a563d2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:18.018123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e21f0f-3856-40ab-b884-0ae9ce8779c6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:18.023849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 235/454] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/role_assignments?group.id=30cd325d704c4418918f890a64ef4a5b&scope.project.id=5f30f0ced3f84e0fbf1b5e4614734b35&role.id=82cfaa1d7baa4067892940a470beb46e => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:18.024006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 220/455] 10.222.0.75 () {56 vars in 1376 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/role_assignments?group.id=67f1f7f689854587aeefd5a8ec50a8cf&scope.project.id=5efb11cead144cc7a5078ee4532b8260&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:20.549784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542b22-2f88-4c0e-872a-64d810f07204 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:20.550837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542b22-2f88-4c0e-872a-64d810f07204 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:20.551650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542b22-2f88-4c0e-872a-64d810f07204 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:20.553474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 236/456] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:20.558627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dbd00-bb54-4fe2-88b3-8a8ed2d5742f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:20.559408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dbd00-bb54-4fe2-88b3-8a8ed2d5742f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:20.559890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dbd00-bb54-4fe2-88b3-8a8ed2d5742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:20.580729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ed4dbd00-bb54-4fe2-88b3-8a8ed2d5742f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:20.582302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ed4dbd00-bb54-4fe2-88b3-8a8ed2d5742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:20.667592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 221/457] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:20.716493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062446b9-c646-4d3a-97a2-2ab24aa1e111 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:20.716842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062446b9-c646-4d3a-97a2-2ab24aa1e111 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:20.717031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062446b9-c646-4d3a-97a2-2ab24aa1e111 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:20.718669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 237/458] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:20.723972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:20.724487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:20.724953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:20.750014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:20.751658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:20.789747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:20.874632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b578be9-ea74-4a83-be6d-707950b646c8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:20.874901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b578be9-ea74-4a83-be6d-707950b646c8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:20.875365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b578be9-ea74-4a83-be6d-707950b646c8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:20.876872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 238/459] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:20.879490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 222/460] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:20.882342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:20.882791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:20.883217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:20.917821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:20.919214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:21.023441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 239/461] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:21.052778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.168277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.199004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aa641-34ed-4516-a179-7e15a458728c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.238177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.264602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.265259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.265533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.265821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.276520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.278033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:21.295173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:21.296113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:21.296976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:21.296976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:21.296976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:21.297629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 223/462] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:21.302417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.350128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.360563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc769c-9a24-4281-8493-3ccb2df3f441 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.440975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.441539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.441824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.442089 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.454700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.456239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.457408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d319a-dec1-4723-9b8e-ac4c8dd01d1b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:21.471892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:21.472779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:21.473677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:21.473677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:21.473677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:21.473677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 240/463] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:21.478857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.496971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.498080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.498558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.499172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.500011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:21.500569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.502380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.517004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 224/464] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:21.518371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.570533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.582849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b834-565d-43f4-a3b9-7820c0a75a31 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.608294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.621585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.622642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.623335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.623983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.631849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b977cf-c87c-4882-95e5-36de868f5b37 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.637794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.639431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:21.655997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:21.657079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:21.658027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:21.658027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:21.658027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:21.659079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 241/465] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:21.659841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.671706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.672488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.672616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.672834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.673473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:21.673912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.675200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692c54-b26d-47de-a62b-3b189967d712 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.686831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 225/466] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:21.688020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9c651-0bed-4da4-b9fb-98d45110d76a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.688297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9c651-0bed-4da4-b9fb-98d45110d76a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.688566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9c651-0bed-4da4-b9fb-98d45110d76a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.690263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 226/467] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:21.690795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9c651-0bed-4da4-b9fb-98d45110d76a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.764405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31fe7f-b5c8-477d-9540-b5865f8620c6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.797544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.798220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.798494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.798759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.798879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9c651-0bed-4da4-b9fb-98d45110d76a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.799423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.800878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.812898 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.824133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 242/468] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:21 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:21.825064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.850869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.852131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.852409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.852933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.853535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:21.853867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.855388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64ffa-dda2-408a-870d-f0fad384e628 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.858970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.870401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 227/469] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:21.871555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa538-3cb6-493e-82f9-9a273a848e98 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.871947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa538-3cb6-493e-82f9-9a273a848e98 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.872215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa538-3cb6-493e-82f9-9a273a848e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.891426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-992aa538-3cb6-493e-82f9-9a273a848e98 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:21.892661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-992aa538-3cb6-493e-82f9-9a273a848e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:21.946616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb45de-beaf-4a90-b460-ec4d741ed418 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.978790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 228/470] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:21.980555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235695-eaca-4139-b8a2-086b9b6a599e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.980848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235695-eaca-4139-b8a2-086b9b6a599e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.981119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235695-eaca-4139-b8a2-086b9b6a599e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.982460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 229/471] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:21.983140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235695-eaca-4139-b8a2-086b9b6a599e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.999748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edd943-baaf-402e-bf18-43dfd17ed724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.000369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edd943-baaf-402e-bf18-43dfd17ed724 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.000641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edd943-baaf-402e-bf18-43dfd17ed724 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.000905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edd943-baaf-402e-bf18-43dfd17ed724 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.001566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edd943-baaf-402e-bf18-43dfd17ed724 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.003094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edd943-baaf-402e-bf18-43dfd17ed724 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.029450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 243/472] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:21 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:22.033944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.033944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.033944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.057165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:22.058475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:22.128622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.134007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235695-eaca-4139-b8a2-086b9b6a599e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.147695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 244/473] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:22.186183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.199509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.200410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.200795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.201166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.202360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.204183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.241954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 230/474] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:21 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:22.278748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.437139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.441441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06de1da-2ac2-461c-8fdd-42dd71401561 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.480564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.481227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.481917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.482190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.495937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.497408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:22.513663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:22.514687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:22.515496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:22.515496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:22.515496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:22.516921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 245/475] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:22.523181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.564510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.638640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d49b-7aea-461f-b98f-907f48ad471a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.678616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090df932-e8c4-462c-bea3-7668d7ba5949 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.725429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.726761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.728757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.729619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.730107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.730964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:22.731755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.732225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.732677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.734279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.734757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.735626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.737245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.752646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.sql.core [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:41:22.752646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:41:22.752646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [parameters: {'id': 'e35e3d4a8d0642f597a4910f4dc6e0ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:41:22.752646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81483) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:41:22.759436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 246/476] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:22.769991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 10:41:22.787126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:41:22.788113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application yield resource Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise self.value Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application session.commit() Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:41:22.789051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:41:22.789935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:41:22.791225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:41:22.792038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [parameters: {'id': 'e35e3d4a8d0642f597a4910f4dc6e0ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:22.792810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:41:22.795109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:22.798589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 231/477] 10.222.0.75 () {60 vars in 1131 bytes} [Wed Aug 31 10:41:22 2022] POST /identity/v3/roles => generated 144 bytes in 362 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:22.807283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.883453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.949554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4315-fc34-4464-8433-93366201ae82 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.988428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.990270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.990755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.991237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:23.009981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:23.015505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:23.018747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:23.019862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:41:23.020633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:23.023311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 232/478] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:41:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:23.028643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:23.036679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe93ba5-4e57-4dd3-92d4-47bd9000f088 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:23.145132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603ec0e-9ef6-411f-8647-93a75d41fee4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:23.146249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5f5c9-4709-4655-a211-840c86bd4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:23.146874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5f5c9-4709-4655-a211-840c86bd4423 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:23.147150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5f5c9-4709-4655-a211-840c86bd4423 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:23.147416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5f5c9-4709-4655-a211-840c86bd4423 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:23.148063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5f5c9-4709-4655-a211-840c86bd4423 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:23.149540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5f5c9-4709-4655-a211-840c86bd4423 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:23.154182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:23.185303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:23.186325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:23.186881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:23.187341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:23.188236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:23.188501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 247/479] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:22 2022] POST /identity/v3/users => generated 249 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:41:23.189026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:23.190674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013cdfb-0151-4bfe-a7ef-d40dcde04e57 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:23.201394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 233/480] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:24.438387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519d3b-7d5b-480e-b751-3125615b0ed7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.438911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519d3b-7d5b-480e-b751-3125615b0ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.438911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519d3b-7d5b-480e-b751-3125615b0ed7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.440785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 248/481] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:24.446069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec87b1-cc4a-407a-aa3e-7667ea0adaca None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.446471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec87b1-cc4a-407a-aa3e-7667ea0adaca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.446647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec87b1-cc4a-407a-aa3e-7667ea0adaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.470649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-29ec87b1-cc4a-407a-aa3e-7667ea0adaca None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:24.471919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-29ec87b1-cc4a-407a-aa3e-7667ea0adaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:24.540085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c961-b698-47b7-b695-a8e764094091 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.540411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c961-b698-47b7-b695-a8e764094091 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.540624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c961-b698-47b7-b695-a8e764094091 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.542281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 249/482] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:24.552170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.552328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 234/483] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:24.552423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.552693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.586770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:24.587959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:24.643311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f7e36-9e9b-4994-b70a-c543aefcd096 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.643594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f7e36-9e9b-4994-b70a-c543aefcd096 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.643874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f7e36-9e9b-4994-b70a-c543aefcd096 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.646487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 235/484] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:24.650560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.650845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.651122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.676487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:24.678620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:24.695739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 250/485] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:24.774936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 236/486] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:24.835706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:24.944262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:24.968561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e071-48bc-46e2-8fdc-47d7ef0cccdd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.013254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.013982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.014255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.014518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.033440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:25.038346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.039200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:25.040391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 251/487] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.046900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.073759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.091015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.175741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61244-87ba-4087-97c0-9e1dd224a167 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.199153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e885-9e57-4f37-81dd-98a0046de7b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.210437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.211078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.211350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.211616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.212278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:25.212566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.213985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.226136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 237/488] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:25.226959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.239009 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.239943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.240516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.241086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.249677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.254813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:25.260542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.261408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:25.262576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:25.265156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 252/489] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.266282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.326021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.335729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150481e2-cedf-4940-b53b-cca590f200f3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.370608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.371642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.372117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.372703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.379596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43e7b-d06c-4008-bc67-d0c50c4852fa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.384609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:25.390655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.391535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:25.392332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:25.400292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 238/490] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.400292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.421409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.422475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.422947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.423434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.436121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.438194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:25.455579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.456993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:25.457866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:25.457866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:25.457866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:25.460251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 253/491] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.461335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.509570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a478-7dc7-4039-8fd1-e24c93feac93 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.522129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.546033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.546651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.546925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.547192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.547851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:25.548146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.549526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.563861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 239/492] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:25.564768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.578687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ed6f2-c4c5-4365-ae7a-2b39a100f7cc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.581122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.617856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.618502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.618781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.619054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.619723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:25.620313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.621431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.630481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 254/493] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:25.635887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.670027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be392-b207-4b94-bd83-533bd3ead817 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.704136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.704757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.705031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.705302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.706106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:25.706402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.707789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4b1c0-c31c-4ca9-9c55-c69200d51ec2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.720683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 240/494] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:25.726302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002af9e-01d6-4308-bcde-6c9f1dc3176e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.726587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002af9e-01d6-4308-bcde-6c9f1dc3176e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.726859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002af9e-01d6-4308-bcde-6c9f1dc3176e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.728124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 241/495] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:25.728833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002af9e-01d6-4308-bcde-6c9f1dc3176e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.747224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f43a1-a57f-4235-b358-e2224cc24843 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.762213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.784890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.785502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.786244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.786528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.798525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.800058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.804734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:25.815206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.816158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:25.816993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:25.816993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:25.816993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:25.816993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 255/496] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.817214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.848457 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002af9e-01d6-4308-bcde-6c9f1dc3176e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.885637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.886317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.886593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.886865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.896979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.898466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1555ffa0-fb62-4957-87ed-e08377d8d410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:25.912796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.918922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 242/497] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e77ea-caa4-4cb5-a7a2-f768e5a37f08 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e77ea-caa4-4cb5-a7a2-f768e5a37f08 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.920061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e77ea-caa4-4cb5-a7a2-f768e5a37f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.925458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9e4e-def0-414e-b992-f365d9509fcc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.934485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8b0e77ea-caa4-4cb5-a7a2-f768e5a37f08 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:25.935687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b0e77ea-caa4-4cb5-a7a2-f768e5a37f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:25.958984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.959612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.959895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.960159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.967579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.969178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:25.982703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:25.983595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:25.984454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 256/498] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:25.985028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.005006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 243/499] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:26.006361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edc0e-3102-4f24-bfdd-22d1f1315bf3 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.006824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edc0e-3102-4f24-bfdd-22d1f1315bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.006947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edc0e-3102-4f24-bfdd-22d1f1315bf3 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.008291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 244/500] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:26.008889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4edc0e-3102-4f24-bfdd-22d1f1315bf3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.018847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.072132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.097111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf189-88c7-46dc-b857-5dce40d02e50 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.118870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4edc0e-3102-4f24-bfdd-22d1f1315bf3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.131372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.131986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.132266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.132524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.133281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:26.133452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.134881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.151393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 257/501] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:26.151393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.159210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.159819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.160096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.160363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.160994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:26.161288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.162674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702a05-ea7d-4c9b-9703-a43816434bba None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.174394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 245/502] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:26.175406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.175678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.175942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.193943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:26.195263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:26.245193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.262066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b831f-d77d-4eb9-a35e-b9716c24e0e5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.263155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 246/503] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:26.264036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.302551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.303079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.303353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.303624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.304349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:26.304646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.306122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.320243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.344837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 258/504] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:26.346065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.384089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6badd5-2c23-4edb-b687-356d30cac234 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.418796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.419482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.419701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.419979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.428310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.429811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:26.443485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:26.444568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:26.445479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 247/505] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:26.446086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.456879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af09eca-88c1-4f62-962f-bb8dc5738a03 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.494859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.495479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.495757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.496025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.503559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.505029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:26.516746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:26.517638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:26.518610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 259/506] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:26.519650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.526667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.557102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72a93-cac0-417e-adb0-491c91fed7b6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.559579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.591781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.592411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.592695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.592964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.603459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.604944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:26.618843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:26.619772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:26.625503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:26.625503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:26.625503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:26.625503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 248/507] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:26.625503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.626931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6486-ec26-4ad3-b737-512e5b4e6416 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.660718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.661317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.661573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.661870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.721117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378153f-f070-49a8-925c-d3893a7f406e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.728151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.729613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.732459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.754940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.755683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.755956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.756221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.756947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:26.757244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.758736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.796888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 249/508] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:26.797602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.815379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.840286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 260/509] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:26.841147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.912987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12aee9-60eb-4d57-8c6b-214ebd9a635c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.944708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d45ce-57b4-4602-a7d4-0ff691de6d0f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:26.946973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.947125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:26.947608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.947869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.948144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.948950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:26.949337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:26.950977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:26.968407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 250/510] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:26.969212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:26.980726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:26.981381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:26.981658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:26.981958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:26.992251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:26.997154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:26.998192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:26.999019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 261/511] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:26.999764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.049440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.078971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e547e5b-3cb3-4bbe-8838-d07870da06cd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.101968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270e4d4-79ee-42ca-aa48-453c87ea6503 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.112455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.113078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.113352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.113615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.115922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:27.116224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.117631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.129354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 251/512] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:27.130218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.138371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.139017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.139294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.139564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.171809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.209834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.211354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.229143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248d32-bb4e-4e06-88f0-ca061aee3c15 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.257471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.263067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.263704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.264020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.264297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.275217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.276692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:27.291408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:27.292490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:27.293487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:27.293487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:27.293487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:27.293487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 252/513] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:27.293487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.315017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 262/514] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:27.315905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.377654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.393231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c70943-3f73-4bba-aee0-6e6d4780e3cb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.414903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ede8e-f99b-4f32-94b5-e1aecc62d2e6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.426622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.427608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.427876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.428136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.449113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.449704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.450013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.450280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.450933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:27.451237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.452625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.460927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 263/515] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:27.461506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.480647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.497139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.498649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.560438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56536063-4026-4727-b9bf-c4d08b5ff512 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.586066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.595669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.596294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.596575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.596889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.597558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.598415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 253/516] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:27.599086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.599274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.629944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 264/517] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:27 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:27.629944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.713995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.731936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62f8e8-b37d-45a9-8a86-e25114dfdd6f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.742577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087e03-d3dc-45bb-996a-bcd5bb40e217 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.779138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.779374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.779613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.779844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.780496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:27.780849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.782451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.786335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.786978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.787758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.787758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.794919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 254/518] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:27.796862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.803453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.806007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:27.824217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:27.825161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:27.826031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:27.826031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:27.826031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:27.826031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 265/519] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:27.826250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.862059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.914873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be0cbe-3746-4023-aa9a-820bf71b2e5b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.932472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2017-0576-4852-9037-63e8cc49a115 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.953006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.953689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.954005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.954252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.965657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.967194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.968075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.968726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.968998 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.969257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.970234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.980579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.982111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:27.984557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:27.985393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:27.986272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:27.986272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:27.986272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:27.986272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 255/520] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:27.987225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:28.000312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:28.001344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:28.007321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:28.007321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:28.007321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:28.007321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 266/521] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:28.007321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.099011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.099570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab071c-30bb-4c83-845a-148c796a9708 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.117670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364df71-6544-47a9-b4cc-a7e7cf6e5efa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.136431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.137077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.137356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.137620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.145331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.146871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.152031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.152643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.152915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.153173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.153824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.154125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.155495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:28.158795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:28.159651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:28.160517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:28.165231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 256/522] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:28.165413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.173602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 267/523] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.173602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.228296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.277252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d93d-9ce4-4033-b12d-b1fc95cfd2ba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.277787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdff80e-8fdc-4f00-b814-9caa29205d09 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.312922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.313530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.313829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.314103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.314419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.314749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.315034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.315136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.315318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.315625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.316323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.316483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.316644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.318052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.328803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 268/524] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.329633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.339146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 257/525] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.339146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.339413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.440177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027f7e-c20b-4a5f-b907-c409c73524a9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.440517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750bad5-353b-4f5a-8b43-fd9742e9a641 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.456837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.474381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.475024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.475287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.475558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.478163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.478861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.479195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.479525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.480279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.480648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.482531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.482794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.484258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:28.495674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:28.496703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:28.497856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:28.501874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 258/526] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:28.502647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.505075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 269/527] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.505075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.571972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.613106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf840d-7a82-4323-b412-a6a66126f6a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.613296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67e95-e9a7-4949-a8ce-c97c15cdd54a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.647800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.648438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.648730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.648983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.650917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.651537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.651812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.652085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.657475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.658935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.659057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.660548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:28.671431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:28.672332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:41:28.673196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:28.673688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:28.674473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:28.675361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:28.677762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 270/528] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:28.678241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 259/529] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:28.678438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.679483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.727650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.783512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fbb67-cf87-4426-bde6-0ef2a458a905 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.798712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa8515-05af-47f5-be75-18d47ec39a1c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.813488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.822609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.823232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.823686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.823789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.824434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.824730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.826234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.834865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.835536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.835815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.836086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.836806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b4d48e600b4d470c88bd1606ea51c263) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.837111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.838601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.844698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 271/530] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.844698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.859227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 260/531] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/role_assignments?user.id=b4d48e600b4d470c88bd1606ea51c263&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.859227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.966041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.971185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f01b7-6eee-4547-9a38-6f339aaadcb3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.980963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685587a-618e-4c8d-9d69-65be034a6145 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:29.014999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.016167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.016979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.017713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.018629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:29.019354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.021653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:29.025085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.025940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.026330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.026665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.027710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:29.027937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.029460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:29.047024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 261/532] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:29.048442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:29.054003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 272/533] 10.222.0.75 () {56 vars in 1139 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:29.054925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:29.103910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:29.171207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad3332-7732-4294-83a1-e096e874999c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:29.178116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc39ed-3b8e-4fc0-88c5-14c1cdb78944 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:29.213120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.214291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.214870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.215405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.216558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=7c86b5bf0b10480e88d5cc2d51ef1cdf) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:29.217055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.217271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.217667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.218018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.218288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.219017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b52dcd18d699460b8a4d298a381a35d0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:29.219322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.219990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:29.220752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:29.227191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 262/534] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:29 2022] GET /identity/v3/role_assignments?user.id=7c86b5bf0b10480e88d5cc2d51ef1cdf&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:29.227971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 273/535] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:29 2022] GET /identity/v3/role_assignments?user.id=b52dcd18d699460b8a4d298a381a35d0&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:29.228629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:29.262082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:29.349748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7dee-5cdc-42c5-a89f-3c53a2ad7828 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:29.387543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729aae0-0cfd-4ea1-936f-d9ca2468a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.388388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729aae0-0cfd-4ea1-936f-d9ca2468a28e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.388665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729aae0-0cfd-4ea1-936f-d9ca2468a28e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.388936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729aae0-0cfd-4ea1-936f-d9ca2468a28e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.467286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729aae0-0cfd-4ea1-936f-d9ca2468a28e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.468795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729aae0-0cfd-4ea1-936f-d9ca2468a28e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:29.501708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:29.587943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 263/536] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:29.593938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:29.616763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb242c-4585-420e-aac8-d819050c74eb None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.617294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb242c-4585-420e-aac8-d819050c74eb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.617294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb242c-4585-420e-aac8-d819050c74eb None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.620001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 264/537] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:29.624270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.624564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.624840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.643336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:29.644631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:29.727162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 265/538] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:29.731728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221123-acf6-4138-a459-3e90296348f7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:29.741866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:29.780946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.782001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.782483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.782965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.806768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.808630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:29.829117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:29.830116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:29.830930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:29.830930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:29.830930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:29.838156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 274/539] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:29.843412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:29.908166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:29.954129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6e55-01c6-4ddd-ac8b-0c2e2699e13f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:29.989920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:29.990595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:29.990869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:29.991139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:29.991788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:29.992083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:29.993493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.006023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 266/540] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:30.011399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.029960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.159170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9222de-3ef6-434c-9095-624376554513 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.192005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:30.231088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.232941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.234546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.235608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.245008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4927f-a2e2-40ac-87b5-2b93966c176a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.260169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:30.267571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:30.268433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:30.269284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:30.275544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 267/541] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:30.282950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.320538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.321692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.323048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.325955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.337702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.340118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:30.365541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:30.366640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:30.367655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:30.369757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 275/542] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:30.375905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.423906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:30.497637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15dcb-ef13-4d4f-89e8-1052714d565b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.531896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fb65e-8f9e-4b5d-95fd-ebd9ecf5c2f0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.571354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.571993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.572267 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.572536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.573237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:30.573535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.575032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.587623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.588255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.588535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.588807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.589474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:30.589787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.591183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.603377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 276/543] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:30.610231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 268/544] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:30.612291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.616312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.682304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:30.710430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:30.732029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326a55-52c4-4a51-8349-4dc13f728641 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.777957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.778641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.778968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.779238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.780019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=694756b0eedc408c8796463b541fe5bc) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:30.780328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.781782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.788104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 277/545] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/role_assignments?user.id=694756b0eedc408c8796463b541fe5bc&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:30.792174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aac1b-1b06-48d3-9724-98276e41ae20 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.880703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.881368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.881656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.881961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.903276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.905179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e8dbd2ce-2b43-441b-b64b-c17d91d68cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:30.928951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:30.930122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:30.931143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:30.931143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:30.931143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:30.933057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 269/546] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:30.938829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.994826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ce04-eca1-4d2e-8047-79794fc2fc61 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.995333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ce04-eca1-4d2e-8047-79794fc2fc61 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.995766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ce04-eca1-4d2e-8047-79794fc2fc61 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.997471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 270/547] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:31.002799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.003374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.003854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.025034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:31.026768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:31.077984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef6626-f5d1-4c0e-9ed7-cdb742c0ac72 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:31.120036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:31.120653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.120929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.122037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.122703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:31.123005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:31.124389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:31.150779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 278/548] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:31.154457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:31.159169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:31.201095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 271/549] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:31.270553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c30b3-142c-41a6-a6f7-774d54821036 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:31.309236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:31.309966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.310247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.310512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.320971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:31.322475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:31.337522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:31.339149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:31.340192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 279/550] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:31.344627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:31.370876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:31.478005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4729e08-c943-4b5e-baa4-09e61ae24698 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:31.523043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:31.523689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.523965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.524236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.524977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:31.525289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:31.526966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:31.556094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 272/551] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Aug 31 10:41:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:31.561733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:31.563494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:31.661422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:31.710549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd745536-d5d4-41b2-b91a-ae059cf63a16 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:31.718134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:31.757615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d3e8-6e71-4e50-9f6e-6ad772ce81d7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:31.766818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32eecc-796e-4ed7-aab1-a3eb8ca998ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:31.767560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32eecc-796e-4ed7-aab1-a3eb8ca998ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.767958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32eecc-796e-4ed7-aab1-a3eb8ca998ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.768302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32eecc-796e-4ed7-aab1-a3eb8ca998ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.800551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a9bcb-637f-4aae-bb93-5322e62e09d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:31.802186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9bcb-637f-4aae-bb93-5322e62e09d2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.803013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9bcb-637f-4aae-bb93-5322e62e09d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.803498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9bcb-637f-4aae-bb93-5322e62e09d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.814370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a9bcb-637f-4aae-bb93-5322e62e09d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-624a9bcb-637f-4aae-bb93-5322e62e09d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:31.819260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:31.820246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:31.821059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 273/552] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:31.822371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c48de8-ffc8-463a-a8e9-857fdfe9f13f None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.822371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c48de8-ffc8-463a-a8e9-857fdfe9f13f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.822371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c48de8-ffc8-463a-a8e9-857fdfe9f13f None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.824005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 274/553] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:31.824831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54f45-36c1-458c-8e4c-c6cc2c40d2ef None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.825104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54f45-36c1-458c-8e4c-c6cc2c40d2ef None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.825371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54f45-36c1-458c-8e4c-c6cc2c40d2ef None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.828313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 275/554] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:31.828313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54f45-36c1-458c-8e4c-c6cc2c40d2ef None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:31.858707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32eecc-796e-4ed7-aab1-a3eb8ca998ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:31.860183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32eecc-796e-4ed7-aab1-a3eb8ca998ce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:31.927922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:31.937453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54f45-36c1-458c-8e4c-c6cc2c40d2ef None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:31.974060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 280/555] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:31.974638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:31.975251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.975352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.975530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.975625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.975788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.975882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.976442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:31.976735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:31.978132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec77d4-4eca-455d-8dac-ecd8591a9900 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:31.980863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:31.988208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 276/556] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:31.989462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:31.989739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:31.990033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:31.998219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:31.999416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:32.008557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:32.009761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:32.073855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 281/557] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:32.073855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.086425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 277/558] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:32.087285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.194007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518cb9d-5422-40a8-a1bd-5884ad6bdd71 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.195780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:32.203904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35fc7a-6c89-4be1-93a7-5aa7de397445 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.244727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.245458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.246220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.246562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.255194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:32.259852 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.261645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.268599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.269531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.272644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.273110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:32.291745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:32.292702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:32.294039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:32.294039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:32.294039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:32.296252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 282/559] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:32.296649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.298285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.301932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:32.325829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:32.326840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:32.327719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:32.327719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:32.327719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:32.329805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 278/560] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:32.331002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.435553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b5d7-127c-40e2-8aa2-927c07647651 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.460710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1a51-ca6d-468d-a78d-ca2f3a83865f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.470634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.471306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.471582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.471851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.472522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:32.472822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.474249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.486340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 279/561] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:32.491621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.495071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.495684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.495956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.496222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.496857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:32.497149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.498542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.515765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 283/562] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:32.515765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.525183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:32.537305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:32.601789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fce216-2ec8-4e2b-b3ae-0e8cda6371c3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.626193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f977292-257f-4c2e-bdf4-ac50106935a9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.636223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.636867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.637148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.637418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.647981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:32.652897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:32.653825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:32.654646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 280/563] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:32.655314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.666425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.667065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.667376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.667605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.678313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:32.683176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:32.684134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:32.684986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 284/564] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:32.686315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.760214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:32.764313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:32.767563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4e2d-fad0-46b4-a5da-05ea36d7d76a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.799867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c91b8-e8f4-422a-b06a-8fd030bd43db None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.804563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.805221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.805495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.805763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.813211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.814701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:32.828939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:32.830110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 281/565] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:32.831270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.849699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.850450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.850800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.851157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.858809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.860371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:32.871886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:32.872974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:32.874086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:32.875125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 285/566] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:32.875983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:32.947638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1e1a-a4f2-46b2-87b9-d877cb2e6d93 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.982439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c31c-1493-413e-8a37-c846822fc1f9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:32.983504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:32.984160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.984441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.984713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.985395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:32.985696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:32.987137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:32.996280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 282/567] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:32.997182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.021985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.026617 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.030890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.031517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.031790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.032055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.032740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.033035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.034453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.042435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 286/568] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.043242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.102190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb27d-20aa-4090-a56a-b713002bbf73 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.137640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.138312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.138584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.138838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.139653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.139950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.141395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.144573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce2fa6-d0ef-4a8b-a3dc-078f06a67305 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.159111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 283/569] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.163906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.181947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.182688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.182967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.183259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.183934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.184237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.185693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c436-edeb-4332-a3b4-a4dd58f25e06 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.197698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 287/570] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.198899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145eb4-08b4-4ca4-9536-90a978982aff None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.199179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145eb4-08b4-4ca4-9536-90a978982aff None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.199453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145eb4-08b4-4ca4-9536-90a978982aff None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.200646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 288/571] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:33.201333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145eb4-08b4-4ca4-9536-90a978982aff None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.248394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.255342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.269594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822669e-7bd2-4f8c-89f5-8fea07b75813 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.301928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.302485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.303100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.303368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.307204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145eb4-08b4-4ca4-9536-90a978982aff None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.313465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.314936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:33.329233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:33.330351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:33.331217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:33.331217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:33.331217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:33.331217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 284/572] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:33.331217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.344522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.345139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.345710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.346001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.355870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.357485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:33.371720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:33.372807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:33.373892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:33.373892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:33.373892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:33.373892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 289/573] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:33.373892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.437328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5096f7-0cab-4e55-ba0e-6df1934275a9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.465282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.470820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.470955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.471451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.471720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.472003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.473271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fc09-f76d-4941-8f08-25c79dd4e3c7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.482544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.484001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f5dcc632-e3e1-4a6f-bd65-c57a6b4d7705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:33.497596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:33.498541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:33.499400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:33.499400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:33.499400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:33.499400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 285/574] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:33.499805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.500073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.500341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.509165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.509793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.510071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.510333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.511054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=33b930c3607b42a5801da45336c9c009) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.511355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.512759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.517320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:33.518522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:33.519261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 290/575] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/role_assignments?user.id=33b930c3607b42a5801da45336c9c009&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.520037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.605420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 286/576] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:33.606252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.652177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8df5-ee85-4319-9d97-29599eae80bc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.692006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.692652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.692905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.693175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.693856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.694154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.695763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.709194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 291/577] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.710106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.738872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.741597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3f22c-2472-4d70-8e8f-97ade5780022 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.762680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.789012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.790378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.790817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.791224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.792056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.792487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.794044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.806745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 287/578] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.807798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.850292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d638bb5-5412-4fca-b789-0fe2dcbdc35a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.887319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.887999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.888268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.888534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.889173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:33.889597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.890999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.906228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 292/579] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.906228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.933360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0c76-d258-46c6-8e30-2553368cf5ca None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.970056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.970800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.971147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.971481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.979699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.981238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:33.992875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:33.994049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:41:33.995261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:33.996060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.996133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 288/580] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:33.996783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.014460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d01b19-fea3-4aa0-8fd4-9d45e7697bdc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.038644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.056945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.057841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.058264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.058665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.073541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.075482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:34.090750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:34.091857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:41:34.092953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:34.098908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 293/581] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:34.098908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.114463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eec8af-a83e-4c79-91ad-ea67250de2bd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.150319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.150881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.151158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.151433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.162621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:34.167898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:34.168787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:34.169668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 289/582] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:34.170621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.206932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e8db-a3ba-4c55-bbc8-949d404a1526 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.242473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.243121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.243389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.243655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.251710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.253952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:34.266185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:34.267286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 294/583] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:34.273060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.275899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.278434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.287236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232de1c-8734-4536-89d1-c3970ab27d2f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.323041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.323755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.324034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.324305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.325028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:34.325331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.326940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.349380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 290/584] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:34.349380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.376776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07ace4-a07b-4506-bc86-9c5d4236898d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.410667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.411274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.411551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.411816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.412542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:34.412839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.414326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.436441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 295/585] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:34.436441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.454606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec1e49-310b-4b9e-83e2-9b77c0296c4a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.490059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.490729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.490964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.491268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.491927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:34.492226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.493587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.498586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.507204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 291/586] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:34.507204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.524014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.546785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eddbb4-bcc5-47b7-8552-587b6050bc23 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.582528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.583640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.583640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.583819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.584374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:34.584669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.586160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.604781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 296/587] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:34.604781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.621807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219463a-f7a9-4eca-9d9d-a2496776c0b9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.657162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.657917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.658262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.658595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.669914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.671366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:34.685860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:34.686778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:34.687635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:34.687635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:34.687635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:34.687635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 292/588] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:34.687851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.710253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebe823-d8ec-4cf3-ad72-dbcdea14c2e5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.732545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.745867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.746524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.746772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.747025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.757820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.759275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.759959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:34.778924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:34.780230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:34.783085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:34.783085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:34.783085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:34.783085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 297/589] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:34.783085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.800696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaecf23-b293-4cb8-a92a-daa431ef4c41 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.839996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.840747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.841320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.841444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.857842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.859322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:34.874510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:34.875482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:34.876363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:34.876363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:34.876363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:34.876363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 293/590] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:34.876602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.891110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8d98-58b5-4800-a778-d6a3850f6096 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.929962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:34.930733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:34.931140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:34.931512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b4d48e600b4d470c88bd1606ea51c263/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:34.946668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=b4d48e600b4d470c88bd1606ea51c263, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:34.948282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:34.965000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 298/591] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:34 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b4d48e600b4d470c88bd1606ea51c263/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:34.966111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:34.997515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dd2cc-fe95-4590-90d2-b56ed28403a7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:34.999853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.018396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.037580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.038692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.039221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.039734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.040657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:35.041174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.042770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.061836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 294/592] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:35.061836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.099056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af32d2-0089-4a6d-aecd-ae67bb7b1a1e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.154041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.155312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.155590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.156265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.156928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:35.157224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.159762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.175506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 299/593] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:35.176528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.184383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a863a-c1e0-47be-bcde-9d7827ca4d65 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.222240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.223483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.224104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.224571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.225453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:35.225987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.227577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.241146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 295/594] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:35.242397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.286857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.290135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.311325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786cefc-2bbe-40d5-a650-7ae7fa62b615 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.357907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa7d2-dc92-43a1-9135-0a1cbef3323a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.361668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.362501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.362913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.363399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.372652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.375130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:35.391394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:35.392467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:35.393522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:35.400517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 300/595] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:35.400517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.401404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.402316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.402700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.403053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.410704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.412493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:35.425112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:35.426354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:35.427547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:35.434162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 296/596] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:35.435454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.514980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348aa1-cc0c-4acb-ab91-83b5333505e9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.539140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.543285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b59c-f34e-4e38-b718-6154eec0eff7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.552288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.553408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.553688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.553983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.562227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.563792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:35.575486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:35.581324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 301/597] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:35.582585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.584959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.585385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.585784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.586153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.586596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.587397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:35.587816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.589377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8f8c7-7eae-4af9-ae97-4a198ce9cc42 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.601694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 297/598] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:35.607629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5f44-856a-468d-828d-43ba850b13a0 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.607907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5f44-856a-468d-828d-43ba850b13a0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.608173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5f44-856a-468d-828d-43ba850b13a0 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.609498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 298/599] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:35.610082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5f44-856a-468d-828d-43ba850b13a0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.694536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe69f-6630-4868-a6a7-4971c107eaac None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.713413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5f44-856a-468d-828d-43ba850b13a0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.728857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.729595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.729898 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.730168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.730990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:35.731293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.732761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.746437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.747054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.747328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.747649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.748376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:35.748693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.750177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8cb9-b5e3-4279-b5ca-d81673dc4ee3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.751247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 302/600] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:35.752208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.771932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 299/601] 10.222.0.75 () {56 vars in 1139 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:35.771932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.771932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.771932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.789084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:35.790290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:35.802614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.824380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.865501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 300/602] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:35.866492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.873211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce116548-c307-438f-9412-86c5d834a582 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:35.910819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:35.911813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.912259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.912840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/7c86b5bf0b10480e88d5cc2d51ef1cdf/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.929693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=7c86b5bf0b10480e88d5cc2d51ef1cdf, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:35.931448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:35.947603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 303/603] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:35 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/7c86b5bf0b10480e88d5cc2d51ef1cdf/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:35.948796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.000633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2ad6-81ff-4ed3-8839-4afd243f434b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.040727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.041983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.042512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.042954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b52dcd18d699460b8a4d298a381a35d0/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.061040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=b52dcd18d699460b8a4d298a381a35d0, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.063097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.067018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.088134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 301/604] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:35 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b52dcd18d699460b8a4d298a381a35d0/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:36.126861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18953-bf8e-4699-9cbc-5867e1dbd06b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.151888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.175565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.183489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.184479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.184955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.185459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.199086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.201109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:36.220149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:36.221236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:36.222164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:36.222164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:36.222164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:36.225316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 304/605] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:36.234609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.338151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761afe7-9e2f-4552-8331-76b75d2e370a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.362321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b83d7-abfb-48b9-92a4-1a9963e83d7b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.375717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.376379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.376651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.376916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.388543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:36.393446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:36.394450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:36.395393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 302/606] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:36.402804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.403638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.404435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.404871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.405266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.406090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:36.406593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.408157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.422123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 305/607] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:36.427450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.462772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.509326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.542087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf119-fc3a-4e17-8939-8e2331fce101 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.578465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.579391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.579927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.580344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.583706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbbf63-d478-4dc6-8d97-129cc4dbbe60 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.587950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.589662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:36.602839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:36.603743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:36.604616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:36.606571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 306/608] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:36.613803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.651441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.652325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.652759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.653152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.653981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:36.654422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.656560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.667413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 303/609] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:36.672230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.770934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.790067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d2bdd-f2a9-45d7-bfdf-8649d2e0efdc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.833628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc788744-063c-4043-a21d-32dbb27cc160 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.855367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.889914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.890752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.891030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.891137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.891369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.891737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.892007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.892312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.893019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:36.893316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.894900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.902818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.904276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:36.920659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:36.921618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:36.922537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:36.922537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:36.922537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:36.922537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 304/610] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:36.925634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 307/611] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:36.928648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.946283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:37.071498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34448df-e949-401f-81a8-5a29773d736a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.075351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400adb-e1ec-4dfd-995c-72b7ebb1f747 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.104967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b52893-821f-41ee-bf1d-eb3cef590552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.105621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52893-821f-41ee-bf1d-eb3cef590552 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.105922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52893-821f-41ee-bf1d-eb3cef590552 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.106187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52893-821f-41ee-bf1d-eb3cef590552 None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/694756b0eedc408c8796463b541fe5bc/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.110877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.111485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.111768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.112040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.112676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:37.112975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:37.114449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74bcf5-3501-4ef9-98e5-a82b3999620d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:37.120887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b52893-821f-41ee-bf1d-eb3cef590552 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=694756b0eedc408c8796463b541fe5bc, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:37.122410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b52893-821f-41ee-bf1d-eb3cef590552 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:37.125514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:37.128617 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 305/612] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:37.130350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d3663-05ae-4066-88db-bd4e24c86f04 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.130781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d3663-05ae-4066-88db-bd4e24c86f04 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.131267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d3663-05ae-4066-88db-bd4e24c86f04 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.137283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 306/613] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:37.138741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d3663-05ae-4066-88db-bd4e24c86f04 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:37.141181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 308/614] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:36 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/694756b0eedc408c8796463b541fe5bc/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:37.146935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.150563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.150730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.175712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:37.187318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:37.189989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:37.337477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d3663-05ae-4066-88db-bd4e24c86f04 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.340961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 309/615] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:37.376209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.377166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.377601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.378068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.387049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:37.388875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:37.402042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:37.403218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:37.404378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:37.406581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 307/616] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:37.411978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:37.514324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c7751-77ae-44e7-9e94-0de8e56821e3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.542442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:37.551404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.552076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.552355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.552623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.553728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:37.554071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:37.555507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:37.573825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 310/617] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Aug 31 10:41:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:37.582979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:37.667766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:37.683357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:37.695299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439fd0-3e2e-4825-af25-0d6138880815 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.733566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.734247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.734525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.734797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.746887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:37.748836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:37.764943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:37.765936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:37.766914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:37.766914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:37.766914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:37.766914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 308/618] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:37.775254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:37.898591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df49e-32df-484f-92fa-06e35d6ced21 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.933919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29282d4-0e66-4e8b-8c73-0ad02d2adbd4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:37.972707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.973904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.974387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.974850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.985902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:37.987359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:37.987979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:37.988250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:37.988553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:37.989196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:37.989490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:37.990924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:37.992738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:37.994001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:37.994894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:37.997373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 311/619] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:38.003779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.021557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 309/620] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:38.036689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.047919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.062827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.123720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048350b-7c38-4e63-8d54-4fc106df8d0a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.160688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.161579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.162017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.162419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.163293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:38.163834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.165363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.175010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 312/621] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:38.181002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.214187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db4cbb-6423-4e42-85c9-309e2059d50c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.250503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.251149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.251426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.251695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.259318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.260948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:38.273440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:38.274578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:38.275634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 310/622] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:38.280576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.295309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd3056-7c02-4358-a7b1-b86059c96e7a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.304006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.335726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.336744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.337271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.337860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.342996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.352349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.354182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:38.370393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:38.371368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:38.372291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:38.372291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:38.372291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:38.374670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 313/623] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:38.380613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.383128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b31f-5556-4961-835a-fb3b31890446 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.417861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.418482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.418766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.419036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.419737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:38.420042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.421743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.439604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 311/624] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:38.440495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.490497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf286a48-c9e9-4efb-afc1-4a20ecee4757 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.525621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.526712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.527096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.527366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.528007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:38.528302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.529736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d18316-f9b7-4064-9c0e-4b33de33286c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.541980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 314/625] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:38.542467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3711263-128d-44be-979f-8ddb9e155713 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.543154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737b81-176a-427c-a7c0-b5d82e0043cb None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.543427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737b81-176a-427c-a7c0-b5d82e0043cb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.543690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18737b81-176a-427c-a7c0-b5d82e0043cb None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.545048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 315/626] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:38.549819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e21c4-a9e4-4789-98d4-bc08e56860d5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.549819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e21c4-a9e4-4789-98d4-bc08e56860d5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.549819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e21c4-a9e4-4789-98d4-bc08e56860d5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.549819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 316/627] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:38.549819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e21c4-a9e4-4789-98d4-bc08e56860d5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.571231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.578265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.590748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e49b0-4733-44d1-bdac-caf9558fb0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.591435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e49b0-4733-44d1-bdac-caf9558fb0b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.591709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e49b0-4733-44d1-bdac-caf9558fb0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.591981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e49b0-4733-44d1-bdac-caf9558fb0b1 None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/33b930c3607b42a5801da45336c9c009/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.607590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e49b0-4733-44d1-bdac-caf9558fb0b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=33b930c3607b42a5801da45336c9c009, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.609115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e49b0-4733-44d1-bdac-caf9558fb0b1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.623918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 312/628] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:38 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/33b930c3607b42a5801da45336c9c009/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:38.625131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae346-48f2-4d11-a9b1-440271b61deb None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.625416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae346-48f2-4d11-a9b1-440271b61deb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.625697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae346-48f2-4d11-a9b1-440271b61deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.647401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3c5ae346-48f2-4d11-a9b1-440271b61deb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:38.648720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3c5ae346-48f2-4d11-a9b1-440271b61deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:38.692242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e21c4-a9e4-4789-98d4-bc08e56860d5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.737878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 313/629] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:38.737878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.737878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.737878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.746217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.746796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.747072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.747341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.766207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:38.768064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:38.769761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.771439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:38.791497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:38.792633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:38.793747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:38.795332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 317/630] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:38.801274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:38.868677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 314/631] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:38.906002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.929503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72358254-c84b-4b4e-8568-0dc7d14773b8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:38.964739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:38.966066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.966477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.966938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.967922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:38.968358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:38.969963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:38.988873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 318/632] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:38.994291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.042614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.046499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.147803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f5da-d9ed-4454-83b0-f70ae9a0c1aa None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.207831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.208718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.209033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.209318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.234719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020859c5-be9e-4b93-ab78-5ff31c926619 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.291743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.292401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.292724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.292938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.297162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.310257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.311556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:39.312306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:39.318141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:39.319074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:39.319915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 319/633] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:39.320588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.351172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.427178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 315/634] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:39.428816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.437036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a298a8-4294-453a-ba26-9324ef0160cb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.472556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.473255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.473529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.473816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.484702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:39.489523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:39.490548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:39.491592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:39.493408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 320/635] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:39.494381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.541215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6c6a-18d0-4558-a72a-0fc61a312513 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.552795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.573653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.580696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.581605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.582121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.582635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.583547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:39.584067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.585677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.594860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 316/636] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:39.595993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.600614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afa062-1e2e-420c-9650-4c629202b4db None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.634672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.635313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.635584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.635845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.646424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.647877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:39.664471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:39.665440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:39.666431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:39.666431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:39.666431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:39.666431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 321/637] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:39.666431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.707179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411dc67-1ab7-4c12-9992-181201d29086 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.747395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.748014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.748287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.748641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.749345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:39.749642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.751061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0df342-c1dd-4690-83ce-8e73ec6e9ff1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.763880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 317/638] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:39.763880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fbdb-974a-48de-bbb7-0740831a87f5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.763880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fbdb-974a-48de-bbb7-0740831a87f5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.763880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86fbdb-974a-48de-bbb7-0740831a87f5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.763880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 318/639] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:39.763880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86fbdb-974a-48de-bbb7-0740831a87f5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.779242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3ef7-c6c6-48ce-9d89-6c836d58ede4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.788814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.816489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.817124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.817525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.817873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.830139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.833609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.835278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:39.853555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:39.854603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:39.855522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:39.855522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:39.855522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:39.858086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 322/640] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:39.860339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.885598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86fbdb-974a-48de-bbb7-0740831a87f5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.922911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.923624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.924005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.924282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.924917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:39.925219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.926853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57384e-2cc7-4a6a-933a-6265d823e37d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.944592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 319/641] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:39.945759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.946091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.946350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.964142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:39.965330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:39.968774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f68c7-9d47-4dac-af90-71d3d8b7c934 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.004638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.005481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.006042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.006310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.017522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.019110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.032884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 320/642] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:40.033723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:40.035464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:40.036476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:40.037378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:40.037378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:40.037378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:40.043529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 323/643] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:40.043988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.061111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.101557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.166655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64a0b-375b-4ccb-bf72-747ecc6f9c46 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.170084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9cbbf-658f-4860-ba23-7c8bbf768597 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.207276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.208408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.208940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.209453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.209668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.210340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.210591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.210862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.211499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:40.211798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.213832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.218146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.219995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.227188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 321/644] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.228181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:40.235918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:40.236796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:40.237903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:40.244347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 324/645] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:40.244347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.329196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.351309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0124851-0cc9-4379-8536-21feeabd0bee None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.358623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.363449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1d518-51f4-47d8-b370-256356b4d7f9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.387051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.387655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.387916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.388355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.388812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:40.389102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.390661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.398903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.399550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.400025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.400545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.410380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 322/646] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.410380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.411651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.413710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:40.426550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:40.427737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:41:40.429235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:40.432625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 325/647] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:40.433522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.517064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606770c-4936-40de-96f2-082b567ff7b0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.536438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68682-567e-45ef-99fe-7d2aeccd5788 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.553831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.554533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.554713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.554978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.555659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:40.555955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.557394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.567841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.574451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 323/648] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.574451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.578782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.579532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.579880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.580214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.591272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:40.596618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:40.597757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:40.598847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:40.604202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 326/649] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:40.604947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.605091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.691627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50b41c-1c15-4646-b597-853bdb1b4bcf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.712202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd675-37a3-4fc8-a22c-24d9888500b9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.727820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.728470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.728746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.729015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.736797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.738309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.747386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.747996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.748266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.748547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:40.749275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:40.750357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:41:40.751265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:40.751778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:40.751778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.751909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 324/650] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:40.751976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.752042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.768071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 327/651] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.768876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.827108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.856705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.872499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15f24-d9a1-49d2-a949-d7b15364fe44 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.882086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31814993-fa34-4908-a049-9cc733ebbff3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.907080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.907699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.908078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.908347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.909051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b4d48e600b4d470c88bd1606ea51c263) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:40.909351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.910842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfae3b-a779-4fef-80eb-34f937d6dc5b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.916577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 325/652] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/role_assignments?user.id=b4d48e600b4d470c88bd1606ea51c263&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.916713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.917185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.917463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.917715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a55ae-5739-4644-bc7c-140c1221b0ac None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.917837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.918014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a55ae-5739-4644-bc7c-140c1221b0ac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.918281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a55ae-5739-4644-bc7c-140c1221b0ac None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.918433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:40.918716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.919630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 326/653] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:40.920141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a55ae-5739-4644-bc7c-140c1221b0ac None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.922535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.933945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 328/654] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.935170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.041090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a55ae-5739-4644-bc7c-140c1221b0ac None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.052543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9062c9-8ddb-4971-b48b-3492e30707d4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.068148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.080067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.080934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.081208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.081521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.082260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:41.082610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.084171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1b2f-8819-4798-9b11-51fccc9d2eaf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.094656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.095290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.095571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.095851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.103634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 327/655] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:41.104963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da630-bdf9-4350-98e5-318b85788133 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.105251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da630-bdf9-4350-98e5-318b85788133 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.105525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da630-bdf9-4350-98e5-318b85788133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.125151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-826da630-bdf9-4350-98e5-318b85788133 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:41.126424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-826da630-bdf9-4350-98e5-318b85788133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:41.129745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.174846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.176378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.210441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 328/656] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:41.213903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da630-bdf9-4350-98e5-318b85788133 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.297813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 329/657] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:41.298938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.314022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.341341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da630-bdf9-4350-98e5-318b85788133 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.383768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.384784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.385133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.385493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.398329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.400181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.407426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7e3d9-1f9e-4354-9e6b-5c871aca408f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:41.418689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:41.419702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:41.420579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:41.420579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:41.420579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:41.421966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 329/658] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:41.422247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.426593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.451258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.452254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.452748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.453254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.528358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.529951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.539408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2efe3-c5a5-4242-8365-b801216dfd0b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.544201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.574967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.575532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.575811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.576079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.586964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.588460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:41.602831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:41.603763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:41.604644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:41.604644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:41.604644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:41.604644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 330/659] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:41.605294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.636995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 330/660] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:41.637882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.653085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.711747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5160-b341-448d-921f-0c3f252872a9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.746007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.746677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.746953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.747230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.747452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498e91-f306-4269-af3a-5617625eddf9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.747949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:41.748249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.749644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.765653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 331/661] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:41.765653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.766907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.791324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.792164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.792440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.792706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.803265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:41.808766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:41.809937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:41.810811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 331/662] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:41.811508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.876146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107d6c7-cd7c-4112-b5c1-1dec5d2e8116 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.879447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:41.916543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98098e4-4ac3-468a-a047-0a76c48895cb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:41.919417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.919417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.919759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.919938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.920578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:41.920884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.922336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.935710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 332/663] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:41.936388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:41.959881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:41.960510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.960785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.961061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.971937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:41.973498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:41.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:41.990340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:41.991200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:41.991200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:41.991200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:41.991200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 332/664] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:41.991873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.018650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.047390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007a6b-0690-41bd-8af2-1a82b9367873 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.085258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.085943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.086222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.086493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.094235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.095660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.101479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd59ae-a241-417b-a702-2315847d3ab5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:42.107393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:42.108415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:42.109352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 333/665] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:42.109994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.135248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.142351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.143348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.143799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.144072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.144748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:42.145039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.147216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.159296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 333/666] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.159296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.219345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089fe9a-ecf9-4e15-b1b4-c015cb4159fd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.251769 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.255224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.255857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.256142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.256451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.264103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.265632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.270137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf9f1-1860-44ac-aebd-cc7423b36bb2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:42.277366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:42.278460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:42.279551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:42.283701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 334/667] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:42.284517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.310791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.311814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.312095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.312623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.313277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:42.313849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.315931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.331396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 334/668] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.332502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.378353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.402913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbfcd8-f750-4bc3-9886-caa66b9e45c7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.440618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb78e-9b61-45d6-93cf-664f60ff0d0d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.441027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.441650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.441980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.442260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.443326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:42.444554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.446053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.464107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 335/669] 10.222.0.75 () {56 vars in 1139 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.465093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.482623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.483318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.483526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.483820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.493955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.495412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.503374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:42.516592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:42.517885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:42.519072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:42.519072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:42.519072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:42.519597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 335/670] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:42.520451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.578442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261cc1-88e6-4cf5-ab96-6d88abb4aed3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.612640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.613384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.613732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.614115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.614880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:42.615273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.616811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.625737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.625923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5078d-8206-45e7-9230-0eb970a163ab None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.630448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 336/671] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.631238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.665919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.666667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.667017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.667363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.674543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.676079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:42.687750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:42.688827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:42.689789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 336/672] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:42.690335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.739922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ed668-38b8-48f8-86ce-8403bcc6eaad None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.752935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.776607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.777198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.777475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.777746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.798235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd337ac-0831-47fa-9c51-28aa2e99ed75 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.838283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.838897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.839170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.839439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.840091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:42.840386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.842253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.862908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 337/673] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.862908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.866615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.871127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.872878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.973190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c907-cb6f-4f6b-9024-055f2dc77e30 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.985013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 337/674] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:42.985013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.995908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.014260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.014903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.015177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.015447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.016209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=7c86b5bf0b10480e88d5cc2d51ef1cdf) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:43.016515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.018099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.024558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 338/675] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/role_assignments?user.id=7c86b5bf0b10480e88d5cc2d51ef1cdf&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:43.025200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.095704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.099481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e2a1-b2ff-4ed2-a828-f49d8732f652 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.144405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.145028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.145357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.145743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.146582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:43.147044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.148508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac6cc-373a-4b60-87ab-81e023b334ec None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.155812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31c573-3118-43b1-8b72-5d0efed2bea5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.163559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 338/676] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:43.165555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d303a9-7a3e-4164-b1e3-f940eeb9f04c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.165956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d303a9-7a3e-4164-b1e3-f940eeb9f04c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.166445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d303a9-7a3e-4164-b1e3-f940eeb9f04c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.168759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 339/677] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:43.173831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d303a9-7a3e-4164-b1e3-f940eeb9f04c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.209678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.210524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.212575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.212575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.222174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.223983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:43.238305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:43.239761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:43.240730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 339/678] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:43.241339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.317355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.326363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d303a9-7a3e-4164-b1e3-f940eeb9f04c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.367918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.368566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.368846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.369122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.375148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b7eb9-f210-45a4-9e19-a15c55b7ddb7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.380095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.381557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-140c928f-676e-44c0-aa39-66c6adfd27ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:43.396347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:43.397337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:43.398238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:43.398238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:43.398238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:43.398238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 340/679] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:43.398901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.399004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.399281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.418638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:43.419985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:43.423622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.424273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.424547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.424815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.425561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b52dcd18d699460b8a4d298a381a35d0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:43.425886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.427394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.428333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.446168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 340/680] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/role_assignments?user.id=b52dcd18d699460b8a4d298a381a35d0&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:43.447039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.512047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 341/681] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:43.513618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.569275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e08a-788f-411c-9699-41a78d064498 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.577330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.608678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.609860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.610344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.610866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.611866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:43.612360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.614165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.635495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 341/682] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:43.641247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.662383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604e2b-52f3-42f4-a6c4-75a4296d84ed None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.701343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.702115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.702376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.702715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.703329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:43.703630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.705082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.717013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 342/683] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:43.722525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.725232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.754271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c4820-1485-4764-bb2b-943e4d1f9725 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.794185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.795033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.795143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.795390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.839480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf1d9-3a34-47e4-bcf9-5842382c325f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.858266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.872695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.874204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.885270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.885976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.886662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.886940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.896341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.898693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:43.914496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:43.915422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:43.916308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:43.916743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 343/684] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:43.921468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.984840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 342/685] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:43.985760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.001949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.054655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.057110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa9d12-1a1b-4853-9f62-f506807ffbda None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.096579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c47bc-11ba-4e31-b6c1-02febf20472c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.102700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.103901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.104837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.105261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.119350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:44.125879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:44.127020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:44.128155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:44.131927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 344/686] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:44.132802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.142004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.142885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.143323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.143737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.144961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:44.145504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.147708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.164169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 343/687] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:44.166195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.242257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca69a24-2ce0-41d3-953e-bb6bd5ed1506 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.274151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.282133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.283420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.283909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.284392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.298602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63b00d-7f25-4f9f-ab8c-7963df49e65b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.299363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.302301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:44.321469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:44.322523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:44.323474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:44.323474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:44.323474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:44.324593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 345/688] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:44.325629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.330967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.344189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.344826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.345109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.345445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.346131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:44.346477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.347864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.357228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 344/689] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:44.358225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.430132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ece12-7e94-4219-86b7-9075d9b5d3b6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.461882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b0023-7539-4917-b4d6-afbbac36204b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.464085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.464924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.465399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.465931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.466861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=694756b0eedc408c8796463b541fe5bc) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:44.467372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.468999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.475469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 346/690] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/role_assignments?user.id=694756b0eedc408c8796463b541fe5bc&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:44.476582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.519849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.520608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.520888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.521212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.521892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:44.522195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.522295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.523590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.552154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 345/691] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:44.553072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.585344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128664d-a386-470c-ab36-0733a06c8301 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.606434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.622266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.623289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.623792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.624261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.635804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.637630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:44.653665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:44.654710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:44.655592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:44.655592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:44.655592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:44.661910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 347/692] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:44.664233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.669113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebe7b-40e0-4dd9-9af0-c0952e77686c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.707798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.708544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.708820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.709091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.717088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.718605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:44.731225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:44.732148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:44.733446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:44.737851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 346/693] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:44.739368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.793956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.808920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e99d8-127c-4e92-adc6-201dc300b58a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.852598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.853223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.853504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.853807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.854709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:44.855015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.856973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.873857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 348/694] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:44.879248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:44.882751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff989fb-4417-451c-9704-78f6142f2b68 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:44.891539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:44.931426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:44.932129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:44.932449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:44.932719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:44.933417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:44.933763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:44.935241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:44.950604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 347/695] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:44.957042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.008706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb91ea-3225-4c09-88d9-1a5e697abaf7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:45.048930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:45.050425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.050966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.051437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.060624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:45.062576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:45.076703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:45.077677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:45.078660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:45.085999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 349/696] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:45.087523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.101702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.155867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3b55-e0d1-471e-b37b-231b902184dd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:45.201242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306b1a2-87a1-4dc8-98f1-6ee9c932bd80 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:45.205747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:45.206918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.207438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.207907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.208916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=33b930c3607b42a5801da45336c9c009) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:45.209435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:45.211666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3eef3-a344-4914-96e9-47cd31ce959a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:45.221261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 348/697] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:44 2022] GET /identity/v3/role_assignments?user.id=33b930c3607b42a5801da45336c9c009&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:45.222886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42da6b-baa2-4bd5-b764-fa908927ad9e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.223388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42da6b-baa2-4bd5-b764-fa908927ad9e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.224478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42da6b-baa2-4bd5-b764-fa908927ad9e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.226748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 349/698] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:45.239547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.239878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.240085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.267198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:45.268814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:45.270896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:45.271653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.271934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.272216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.272952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:45.273263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:45.275784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:45.305239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.322571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 350/699] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:45.328855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.388312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 350/700] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:45.490640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.515171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615612c6-ccb6-4527-88d3-f24e48e829a4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:45.566708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4ecbd-76bb-49f3-8ec2-4a058a58eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:45.567340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ecbd-76bb-49f3-8ec2-4a058a58eadc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.567673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ecbd-76bb-49f3-8ec2-4a058a58eadc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.567949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ecbd-76bb-49f3-8ec2-4a058a58eadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.661353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4ecbd-76bb-49f3-8ec2-4a058a58eadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:45.662907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4ecbd-76bb-49f3-8ec2-4a058a58eadc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:45.675422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.791819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.810328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d89c04-de66-4187-a12b-047b0c761769 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:45.840061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 351/701] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:45.841386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835b21-3fad-41af-becd-51a4667576d7 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.841671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835b21-3fad-41af-becd-51a4667576d7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.846583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835b21-3fad-41af-becd-51a4667576d7 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.848201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 352/702] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:45.849051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835b21-3fad-41af-becd-51a4667576d7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.865200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:45.866154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.866433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.866700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.881244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:45.883386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-19202d4a-b173-43ab-90e7-0dabf0ba7037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:45.902918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:45.904074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:45.905109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:45.905109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:45.905109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:45.905109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 351/703] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:45.909871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.909871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.909871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.928643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:45.930643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:45.941645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.980168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835b21-3fad-41af-becd-51a4667576d7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.016453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.017190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.017366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.017641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.022637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 352/704] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:46.023712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.038428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.040951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:46.073637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:46.074713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:46.075610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:46.075610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:46.075610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:46.075610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 353/705] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:46.080803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.125117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:46.139318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f923d1-409d-457e-9aa2-00f57b3a7a2d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.176943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.178004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.178455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.179362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.180289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:46.180762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.182571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.195083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 353/706] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:46.206166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.209931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:46.279269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3f4f-d110-408a-a3c3-3b21c6294389 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.321746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49df76-a294-4a07-9798-e9e5f5e1f7e7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.355394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.356037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.356314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.356588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.357429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:46.357736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.358827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.359172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.359858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.360316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.360839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.361788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.363373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.388117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 354/707] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:46.392358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 354/708] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:46 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:46.396940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.526853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.527697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:46.553307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e891076-3076-40d2-af84-4d73967f393a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.589384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.590077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.590364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.590650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.597712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.599623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.603314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:46.611305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:46.612980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:46.613922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 355/709] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:46.618510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.658420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb56815-a220-49af-b501-cfad8b413b3c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.697040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.698108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.698585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.699050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.700052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.701840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:46.714641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:46.715698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:46.716522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:46.719592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 355/710] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:46.725357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d77bb-18da-4837-ac37-dc1bc10eedb3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.726760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.759358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.759982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.760262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.760534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.761229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:46.761532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.763044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.771797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:46.775533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 356/711] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:46.781530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.844193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2a430-1e87-4d7e-a9b5-795dde73ccb4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.873123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:46.889559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.890821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.891732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.892518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.893707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:46.894657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.896707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.897785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793855c3-94ab-49a7-b85d-f28e736fa479 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.903639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 356/712] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:46.910798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.937556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.938028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.938305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.938578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.939377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b4d48e600b4d470c88bd1606ea51c263) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:46.939604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.941084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d060fc-fe9e-4d2a-9fce-4f17c06190d3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.948142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 357/713] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/role_assignments?user.id=b4d48e600b4d470c88bd1606ea51c263&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:47.047873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce2e8a-bfdb-4aba-afbc-b0c0e7f2dfd5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:47.060618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04102851-e1b6-4751-a35d-a07eaa1d7a8d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:47.060939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04102851-e1b6-4751-a35d-a07eaa1d7a8d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:47.061164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04102851-e1b6-4751-a35d-a07eaa1d7a8d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:47.062814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 358/714] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:47.075320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37731905-3232-4717-b87d-8a51e702eb94 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:47.075667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37731905-3232-4717-b87d-8a51e702eb94 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:47.075862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37731905-3232-4717-b87d-8a51e702eb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:47.098716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:47.099860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:47.100356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:47.100854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:47.102983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:47.103562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:47.106514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4406b0b-0803-4e92-b0c0-0f9681bd02e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:47.115347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-37731905-3232-4717-b87d-8a51e702eb94 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:47.118326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-37731905-3232-4717-b87d-8a51e702eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:47.122731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 357/715] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:47.196987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:47.209096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 359/716] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:47.532237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aac7d-bee3-4797-9a77-a5460deeff5b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:47.533333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aac7d-bee3-4797-9a77-a5460deeff5b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:47.533827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aac7d-bee3-4797-9a77-a5460deeff5b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:47.535702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 358/717] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:47.540923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:47.541754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:47.542244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:47.549116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aac7d-bee3-4797-9a77-a5460deeff5b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:47.566822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:47.568687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:47.651370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:47.689476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 360/718] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:41:47.748387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aac7d-bee3-4797-9a77-a5460deeff5b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:47.799489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:47.800042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:47.800319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:47.800590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] PATH_INFO: `/v3/services/network` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:47.801174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:47.802603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:47.814500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:47.815487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:47.816293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:47.818701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 359/719] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:47 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:47.823958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:47.971437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be4651-7e09-4c20-9d10-8ed966f5b6c7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:47.997404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:48.019460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.020360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.020819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.021237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.022071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] RBAC: Adding query filter params (name=network) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:48.022513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:48.024049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:48.029645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 361/720] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:48.035406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:48.071110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:48.189257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4cfc-3175-42dd-b075-cd9d6a9d696e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:48.231229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.232119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.232796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.234734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.255408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:48.261455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:48.262609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:48.263667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:48.271055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 362/721] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:48.274862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a8997-c046-4cb5-b955-15581d303b26 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:48.277296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:48.314116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:48.346834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.347373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.347648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.347918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.348549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] RBAC: Adding query filter params (type=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:48.348851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:48.350277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:48.363363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 360/722] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:48.371986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:48.430923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d38a-018e-4cfe-996d-11d696b7f5a3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:48.473250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.473953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.474287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.474555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.475246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:48.475547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:48.476954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:48.490307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 363/723] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:48.496305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:48.649158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995921-1142-4ecb-a70c-750ece62712f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:48.689693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.690387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.690664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.690932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.704638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:48.706142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:48.723308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:48.724329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:48.725181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:48.725181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:48.725181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:48.725181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 361/724] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:48.730442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:48.886262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1a1a-482f-4264-94ec-f6252ea37782 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:48.901926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:48.932716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.933356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.933635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.933944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.934586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:48.934884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:48.936271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47028-bf28-4568-9091-994a820b37bf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:48.953263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 364/725] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:48.959040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.010215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:49.117822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52d95-7f15-4469-8023-ce55699e94ba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:49.120146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4547aa-3e51-4602-be1e-83279bf7497b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.120443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4547aa-3e51-4602-be1e-83279bf7497b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.120709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4547aa-3e51-4602-be1e-83279bf7497b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.122400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 365/726] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:49.129795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8222de-9067-4578-aee9-1e90ef3e4660 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.129795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8222de-9067-4578-aee9-1e90ef3e4660 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.129795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8222de-9067-4578-aee9-1e90ef3e4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.149748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fe8222de-9067-4578-aee9-1e90ef3e4660 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:49.151277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fe8222de-9067-4578-aee9-1e90ef3e4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:49.182512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:49.183219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.183496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.183763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.203445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:49.204908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d88e0faa-fb85-4803-b888-666c31bb61a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:49.224460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:49.225441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:49.226430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:49.229861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 362/727] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:49.231291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f618d-a0ca-4d19-9fbd-1a168f7994b6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.231570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f618d-a0ca-4d19-9fbd-1a168f7994b6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.231841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f618d-a0ca-4d19-9fbd-1a168f7994b6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.233279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 363/728] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:49.234644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f618d-a0ca-4d19-9fbd-1a168f7994b6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.259086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 366/729] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:49.259462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.261348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.261348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.300634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:49.302278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:49.406739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:49.424805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f618d-a0ca-4d19-9fbd-1a168f7994b6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:49.454247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 367/730] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:49.483527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:49.484507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.485019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.485502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.486540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:49.487034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:49.488714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:49.512102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 364/731] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:49.518426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.541978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.562936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:49.636132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988cac0-bf5d-483a-a3d0-14966a737374 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:49.670259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73af215-6918-4d84-87df-025cd069b543 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:49.678774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcaf6e-5349-4dc3-8242-c279a9306ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:49.680105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcaf6e-5349-4dc3-8242-c279a9306ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.680934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcaf6e-5349-4dc3-8242-c279a9306ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.681407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcaf6e-5349-4dc3-8242-c279a9306ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.706199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85153a-0b99-4335-9cf0-7838b063e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:49.706750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85153a-0b99-4335-9cf0-7838b063e12b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.707022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85153a-0b99-4335-9cf0-7838b063e12b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.707282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85153a-0b99-4335-9cf0-7838b063e12b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.717620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85153a-0b99-4335-9cf0-7838b063e12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1e85153a-0b99-4335-9cf0-7838b063e12b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:49.722446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:49.723423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:49.724296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 365/732] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:49.725479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0c6c-12c0-4af4-b1aa-5a66b86878fc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.725479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0c6c-12c0-4af4-b1aa-5a66b86878fc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.725706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0c6c-12c0-4af4-b1aa-5a66b86878fc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.731585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 366/733] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:49.732938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e0c6c-12c0-4af4-b1aa-5a66b86878fc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.743896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:49.770679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcaf6e-5349-4dc3-8242-c279a9306ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:49.772274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcaf6e-5349-4dc3-8242-c279a9306ba4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:49.803129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:49.842092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e0c6c-12c0-4af4-b1aa-5a66b86878fc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:49.877971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:49.878826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.879250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.879677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.880580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:49.881036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:49.882596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:49.886247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 368/734] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:49.887509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.887791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.888060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.894704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 367/735] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:49.895772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.910392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:49.911599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:49.968944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:49.985803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 369/736] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:49.985803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.018796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f029-ceff-4d88-bc00-33e8e9c9f91a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.045251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.064415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.065291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.066106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.066530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.080157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:50.088879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:50.090150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:50.090992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:50.093903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 368/737] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:50.094899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.097731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83215b4-fb92-461c-b74a-4a6fed725f4d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.134299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.134945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.135226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.135550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.146687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.148307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:50.163844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:50.164799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:50.165699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:50.165699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:50.165699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:50.169701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 370/738] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:50.170590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.220678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb7ba-c846-4734-983f-94c3db954b53 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.256650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.265839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.266648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.266930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.267198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.277218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc382c69-f193-4485-9c54-0681e70b13ea None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.278666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.280137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.291397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:50.294776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:50.295690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:50.296583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:50.296583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:50.296583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:50.296583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 369/739] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:50.297327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.319393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.320026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.320299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.320574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.321261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:50.321563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.323015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.331889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 371/740] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:50.331889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.406171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2de5-f19f-4990-806a-201e372a0016 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.436412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e8b1-eb3d-4f07-87ab-a75b387e5750 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.443801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.444418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.444690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.444952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.446003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:50.446302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.448032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.465281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 370/741] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:50.465281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.476491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.477050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.477322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.477598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.478278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.479706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.498789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 372/742] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:41:50 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:50.502802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.511076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.555704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.589313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b278b-d94c-4319-9d02-0d0fa5183933 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.636983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387e64-b4b2-485e-b2d3-5a6c484a3195 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.637550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.638219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.638495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.638774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.639423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:50.639720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.641116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.656221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 371/743] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:50.656703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.677666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.678371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.678958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.678958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.691135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.692594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-107073fb-d4f0-4c0e-9727-1fea72934cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:50.707008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:50.708007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:50.708958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:50.708958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:50.708958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:50.708958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 373/744] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:50.709706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948e67-6879-45af-9573-6afeadc416d0 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.710009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948e67-6879-45af-9573-6afeadc416d0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.710278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948e67-6879-45af-9573-6afeadc416d0 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.711667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 374/745] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:50.716766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948e67-6879-45af-9573-6afeadc416d0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.772873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.776710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e314f-4c8a-45b7-9da9-505b7a46898c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.803337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:50.813759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.814427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.814705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.814972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.823079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.825277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.832559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948e67-6879-45af-9573-6afeadc416d0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:50.838250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:50.839304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:50.840202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 372/746] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:50.840677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.877798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.878461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.878736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.878996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.887149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.888664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0e55a0c6-a651-4578-adb7-3756436a1686 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:50.900535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:50.901682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:50.902654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 375/747] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:50.903277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.903277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.903398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.922876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:50.924063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:50.955230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eeabb-3300-4df6-a64b-c31d3f1c488d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.991556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.992170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.992446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.992716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.993376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:50.993676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:50.995084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.001556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 376/748] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:41:51.001556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.014390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 373/749] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:51.015481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.037181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.110829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.126133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05590ec2-5aac-4fd7-ba37-28a962053c79 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.151069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93760-0e6d-43f5-b07e-118264b03696 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.168395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.169385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.170049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.170638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.171603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:51.172100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.173892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.188053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.188672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.188950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.189222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.189973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:51.190672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.191841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.194791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 374/750] 10.222.0.75 () {56 vars in 1149 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:51.195891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.208486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 377/751] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:51.209547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.281750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.307949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152220-c96c-4cc1-96c4-bd3290d38e88 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.320655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca4dc1-83ef-4a82-a863-8a3655843eab None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.348526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.349675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.350071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.350350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.354826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.360837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.361014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.361616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.361931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.362202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.362358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:51.376226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:51.377202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 375/752] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:51.378815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.436850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.438356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.480377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cca94-9d93-40d2-ac06-3f57ac4661e0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.516240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.516853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.517125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.517391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.518153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=33b930c3607b42a5801da45336c9c009) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:51.518456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.520345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.524007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.527968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 376/753] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/role_assignments?user.id=33b930c3607b42a5801da45336c9c009&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:51.528751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.576342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 378/754] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:41:51.577185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.613219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.654754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca7d8e-bb90-490d-bb57-b1eb6e6cc82f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.694920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.695569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.695830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.696098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.696775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.697430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e032aa-5ae4-4747-97eb-6d4103930748 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.699142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.717870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 377/755] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:41:51 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:51.718912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.769282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.770038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.770340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.770587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.771394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:51.771794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.773456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.800779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.821483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 379/756] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:51.829500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.850465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abef60d-3472-4998-9109-6f6b37df6a90 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.895396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.897052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.897337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.897706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.913483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.915059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:51.935226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:51.936187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:51.937056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:51.937056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:51.937056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:51.937751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 378/757] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:51.941858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.955577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.972057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410e71-5e30-4112-a744-0863df357993 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.013249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.013924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.014201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.014472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.027756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.029559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:52.047714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:52.048728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:52.050067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:52.050067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:52.050067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:52.050067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 380/758] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:52.055119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.066961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b7ce-c244-4a6a-adaa-3171cde57eb4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.086236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:52.123066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.124208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.124501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.124830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.125779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:52.126126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.128175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.145507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 379/759] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:52.151214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.176297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9f07f-f96f-4b01-b096-fdd630b8ac4e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.211768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.212381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.212695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.212968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.213603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:52.213931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.215318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.222773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:52.229448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 381/760] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:52.234772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.338913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c93bc-5920-436b-8877-b7427d44dd67 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.373998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.374664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.374940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.375208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.382641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.384094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.384980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d659e4-6c8f-47bd-a3a7-98f995ac8af1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:52.395724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:52.401327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 382/761] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:52.407957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.452689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.453320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.453640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.453933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.467994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.472677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:52.497955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:52.500018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:52.502178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 380/762] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:52.508873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.522155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:52.556167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:52.601092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30edcb1-3564-4e47-b6dd-0fd2ff8beed3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.635959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.636563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.636835 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.637106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.637794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:52.638124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.639552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092c1e-97df-4400-8122-7212bad5a865 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.652407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 383/763] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:52.658627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352b95-10c2-456d-a6ae-7fc454d47b65 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.658906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352b95-10c2-456d-a6ae-7fc454d47b65 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.659174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352b95-10c2-456d-a6ae-7fc454d47b65 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.660669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 384/764] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:52.661349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352b95-10c2-456d-a6ae-7fc454d47b65 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.691496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916758c6-00ee-40eb-97f4-ac86e2c0d9c5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.728930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.729647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.729952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.730225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.730921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:52.731224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.732837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9e928-ba75-417a-abaa-407ce2819df9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.745897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 381/765] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:52.747130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.747505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.747781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.766519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352b95-10c2-456d-a6ae-7fc454d47b65 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.770815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:52.772145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:52.784744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:52.802949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.803660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.803936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.804302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b4d48e600b4d470c88bd1606ea51c263/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.806722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=b4d48e600b4d470c88bd1606ea51c263, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.808212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.825453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 385/766] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:52 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b4d48e600b4d470c88bd1606ea51c263/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:52.847243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 382/767] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:52.848551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.005001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee23422-50f4-444b-b4b3-bb3ab9cb795d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.058434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.059065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.059340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.059603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.060348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=cc4e648a859f42a7af9117651759baba) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:53.060643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.062173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.069313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 386/768] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/role_assignments?user.id=cc4e648a859f42a7af9117651759baba&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:53.113330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.141158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:53.227369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2a18c-04e8-4e9e-83da-00cfc22d4709 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.269845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.270428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.270706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.270977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.271625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.273039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:53.283172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:53.285535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:53.287764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 383/769] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:53.293282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.351389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:53.405365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f2a4-f6e3-4377-9e36-869706c4359d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.441249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130836-0d3f-4996-8515-25924788c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.441906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130836-0d3f-4996-8515-25924788c687 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.442210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130836-0d3f-4996-8515-25924788c687 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.442483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130836-0d3f-4996-8515-25924788c687 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.443127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130836-0d3f-4996-8515-25924788c687 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:53.443469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130836-0d3f-4996-8515-25924788c687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.444869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130836-0d3f-4996-8515-25924788c687 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.450157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 387/770] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:53.455860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.547567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:53.563635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32942a-6bb9-4516-a667-3d7315f8c718 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.598073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.598701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.598982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.599254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.599951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:53.600249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.601646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.607583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 384/771] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:53.613481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130836-0d3f-4996-8515-25924788c687 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.716206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130836-0d3f-4996-8515-25924788c687 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.724144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:53.751617 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.752292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.752576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.752852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.753568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] RBAC: Adding query filter params (interface=public, service_id=c03efc5653344ec7afe43cfbde575254, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:53.753920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.755433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca703fe-7680-43cd-8e98-ae3a239e31eb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.763803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 388/772] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/endpoints?service_id=c03efc5653344ec7afe43cfbde575254&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:53.769453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.796325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7f3e-5882-4d2a-ab0b-3b948557929a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.796641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7f3e-5882-4d2a-ab0b-3b948557929a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.796875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb7f3e-5882-4d2a-ab0b-3b948557929a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.799635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 389/773] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:53.803741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fab61-f278-48ee-813b-183484579106 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.804353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fab61-f278-48ee-813b-183484579106 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.807433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fab61-f278-48ee-813b-183484579106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.847515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-462fab61-f278-48ee-813b-183484579106 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:53.848095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-462fab61-f278-48ee-813b-183484579106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:53.886134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce068-cd91-49d4-9cf1-769e952196a9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.922370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa737378-bfb1-470c-9069-215d72eec1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.923035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa737378-bfb1-470c-9069-215d72eec1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.923315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa737378-bfb1-470c-9069-215d72eec1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.923582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa737378-bfb1-470c-9069-215d72eec1d6 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.924192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa737378-bfb1-470c-9069-215d72eec1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.925562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa737378-bfb1-470c-9069-215d72eec1d6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.932060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 385/774] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:54.036708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 390/775] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:54.171705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007840c-a83f-4568-acf5-5c92a820a864 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:54.172085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007840c-a83f-4568-acf5-5c92a820a864 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:54.172250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007840c-a83f-4568-acf5-5c92a820a864 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:54.173991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 386/776] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:54.180165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:54.180449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:54.180721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:54.202126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:54.203322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:54.275265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 391/777] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:54.369255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007840c-a83f-4568-acf5-5c92a820a864 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:54.391206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:54.487145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007840c-a83f-4568-acf5-5c92a820a864 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:54.531345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:54.531992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:54.532268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:54.532540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:54.547923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:54.549967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:54.553092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:54.554017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:54.555214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 387/778] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:54.561794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:54.604332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:54.698221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:54.718481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabdc50-6258-4732-8a0f-0929582c9883 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:54.752184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818aeb4-c7d2-47d4-a8a2-afb27b6db8f7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:54.755017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:54.755695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:54.756082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:54.756357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:54.757026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:54.757327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:54.759679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:54.768829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 388/779] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:54.776112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:54.815574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:54.816208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:54.816478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:54.816742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] PATH_INFO: `/v3/services/network` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:54.817316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:54.818903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:54.838169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:54.839383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:54.840235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:54.851567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 392/780] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:54 2022] GET /identity/v3/services/network => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:54.857529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:54.968959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4922373-23c8-44ee-965c-e3f68c0eef7f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.023226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:55.030292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.030938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.033791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.033791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.035723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f50d64-0a32-4c23-a8e7-133c991387ba None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.050894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:55.054432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.056164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:55.080396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:55.082631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:55.084813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:55.084813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:55.084813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:55.084813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 389/781] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:55.093704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.098120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.098740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.099010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.099271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.100477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:55.100790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.102204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.115947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 393/782] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:55.123027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.237104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0b356-0591-4b64-ba4c-4bb5482366a9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.283410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.284001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.284278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.284542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.285172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] RBAC: Adding query filter params (type=network) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:55.285469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.287068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.293739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 394/783] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:55.299866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.331497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:55.346420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd82d-a19f-42b3-a87e-39a97fc2c3ec None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.423515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5782a63-4c00-497a-b360-cd79bcedeb9a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.424324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.425184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.425658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.426213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.427133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:55.427625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.429248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec0d01-6216-4838-84a2-dd436cc4682d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.452793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 390/784] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:55.459179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b453a3-4706-4860-b4c6-c7831b0abd5b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.459558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b453a3-4706-4860-b4c6-c7831b0abd5b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.459839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b453a3-4706-4860-b4c6-c7831b0abd5b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.461447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 391/785] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:55.462293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b453a3-4706-4860-b4c6-c7831b0abd5b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.469444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.470115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.470397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.470726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.471986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] RBAC: Adding query filter params (interface=public, service_id=6034a02195cf404cbd9465cb9bebaa69, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:55.472309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.474338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26457e-c985-4ab1-a4e5-8744e8d5e8d2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.481940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 395/786] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/endpoints?service_id=6034a02195cf404cbd9465cb9bebaa69&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:55.483277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.483560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.483832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.506874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:55.508075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:55.521229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:55.578300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b453a3-4706-4860-b4c6-c7831b0abd5b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.592033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 396/787] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:55.593060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.611682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:55.616054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.616694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.617689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.617988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.626340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.628055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e868b53c-0c40-4b78-a375-00d1235b058b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:55.641283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:55.643486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:55.645719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 392/788] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:55.654513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaf2f1-d62f-4724-937f-ff707d9501f9 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.654513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaf2f1-d62f-4724-937f-ff707d9501f9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.654513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaf2f1-d62f-4724-937f-ff707d9501f9 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.654513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 393/789] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:55.654513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaf2f1-d62f-4724-937f-ff707d9501f9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.702115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5019-0316-4bef-bd9a-751218b81ff5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.739246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad64ea-9f7a-417f-ad91-9a4af18671a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.739895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad64ea-9f7a-417f-ad91-9a4af18671a6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.740344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad64ea-9f7a-417f-ad91-9a4af18671a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.740624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad64ea-9f7a-417f-ad91-9a4af18671a6 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.741384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad64ea-9f7a-417f-ad91-9a4af18671a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.742841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad64ea-9f7a-417f-ad91-9a4af18671a6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.748789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 397/790] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:55.750119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.750399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.750673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.770574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:55.771911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:55.772090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaf2f1-d62f-4724-937f-ff707d9501f9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:55.791029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:55.835814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:55.836362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.836633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.836897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.837646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:55.837968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:55.839812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:55.883830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 394/791] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:55.894996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.917990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 398/792] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:55.919864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:55.936695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.016156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957dba-be46-4b1e-a37e-53e966eb8398 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.054811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.056175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.056645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.057134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.069243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:56.070860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bae7f5-1e50-4ce4-a1ef-691acfaf1f6d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:56.074445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:56.075550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:56.076405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:56.083360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 395/793] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:56.084304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.118332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.121346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.122488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.123143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.124329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.138818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.141381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.198840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c879-73e1-4bab-8430-20f46058e363 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.243362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.244437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.244887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.245327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.246209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:56.246702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.248280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.259275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 396/794] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:56.260499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:56.301950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:56.302993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:56.303906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:56.303906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:56.303906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:56.311255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 399/795] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:56.311255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.354060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.366801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e34988-919a-4a6a-a502-8105ded5b177 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.378961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.408507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5622d2-6a01-45ef-a377-db3227e473f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.409410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5622d2-6a01-45ef-a377-db3227e473f4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.409855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5622d2-6a01-45ef-a377-db3227e473f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.410311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5622d2-6a01-45ef-a377-db3227e473f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.420038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365fe1-7312-4b33-9aaf-f26b11331861 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.421397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5622d2-6a01-45ef-a377-db3227e473f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1c5622d2-6a01-45ef-a377-db3227e473f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:56.426709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:56.427824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:56.428820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 397/796] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:56.429637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b801-8fa5-4955-a52e-fa5bb7dbf73c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.429637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b801-8fa5-4955-a52e-fa5bb7dbf73c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.429803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b801-8fa5-4955-a52e-fa5bb7dbf73c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.431297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 398/797] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:56.431978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b801-8fa5-4955-a52e-fa5bb7dbf73c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.467912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.468808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.469269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.469535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.482918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.484402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:56.498938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:56.499896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:56.501444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:56.501444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:56.501444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:56.501444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 400/798] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:56.501444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.548828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b801-8fa5-4955-a52e-fa5bb7dbf73c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.584742 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.585682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.586134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.586410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.587065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:56.587374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.588760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d4696-0958-46c1-9f91-d06b9088d69b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.602749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 399/799] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:56.602749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.602749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.602749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.612063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c5aa-38b4-430f-8274-6c1c3cb16ee1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.620874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:56.622178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:56.624197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.627898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.650857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.651391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.651662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.651933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.652671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:56.652998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.654559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.667690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 401/800] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:56.667690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.705799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 400/801] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:56.705799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.778251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172063d-3a35-41b1-8814-e91d7840d6f8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.815928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.816761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.817127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.817494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.818277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:56.818719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.820183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.824911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd60827-df6e-4662-b97e-0f25e3bd95e2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.838950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 402/802] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:56.840025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.867373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.868017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.868292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.868565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.877649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.879835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.882371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.887107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:56.901064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:56.902235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:56.903131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:56.910276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 401/803] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:56.911598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.968298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0a8a4-1de5-4902-aee3-1d0cc778876a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.005486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.006536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.006821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.007090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.018614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.020070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.027161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b010b-ba41-459a-a094-d585b68f3707 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:57.039316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:57.040251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:57.041125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:57.041125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:57.041125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:57.041125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 403/804] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:57.041905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.069196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.069853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.070285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.070556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.080204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.081675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:57.094208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:57.095424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:57.096653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:57.100561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 402/805] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:57.101372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.136881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.150701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671d89d-6981-4423-a73c-3df4466d1d62 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.163352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.187358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.187904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.188182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.188455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.189164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:57.189468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.190977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.206088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 404/806] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:57.207600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.222701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc129268-3779-442b-970e-8bd17d929397 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.264097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.264729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.265005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.265397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.266248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.267505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:57.277320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:57.278358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:41:57.279212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:57.283502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 403/807] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:57.284353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.315909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe0dc6-d35e-4c9d-af44-9f50f6f9ac95 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.352251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.352869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.353149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.353419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.354095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:57.354398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.355792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.369827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 405/808] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:57.369827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.383083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.396216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27057b3-4996-4b3a-a904-466fca003408 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.423878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.437040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.437876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.438180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.438535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.439375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:57.439816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.441277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.463418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 404/809] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:57.463418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.486870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5d33-9553-4f5b-bb83-a0153ede1168 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.524560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.525340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.525817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.526151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/33b930c3607b42a5801da45336c9c009/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.528120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=33b930c3607b42a5801da45336c9c009, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.530046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.553815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 406/810] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:57 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/33b930c3607b42a5801da45336c9c009/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:57.553815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.579676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93d97b-decf-4942-85f3-fa3e36e77e09 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.621217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.622138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.622517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.622883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.623642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:57.624085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.625664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.636211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 405/811] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:57.637391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.653902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.692405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.706709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8600cbb-3254-4d92-8613-07bd7b746ecd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.756149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.756807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.757085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.757354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.763845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33771831-5aff-4c90-bd22-5160995c6258 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.765396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.766953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:57.779487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:57.780455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:41:57.781406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:57.785478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 407/812] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:57.786445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.810002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2191ded-46a2-4430-8a9c-4731c56ceeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.811457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2191ded-46a2-4430-8a9c-4731c56ceeeb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.812079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2191ded-46a2-4430-8a9c-4731c56ceeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.812630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2191ded-46a2-4430-8a9c-4731c56ceeeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.891668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c9c2-69f4-4131-a010-aebe14dba544 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.905696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2191ded-46a2-4430-8a9c-4731c56ceeeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.908103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2191ded-46a2-4430-8a9c-4731c56ceeeb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.919942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.930061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.931015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.931291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.931565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.932186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:57.932543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.934033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.943964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 408/813] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:57.943964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.971398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.037586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 406/814] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:58.039713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912af04-daa4-4581-a593-3fc7dc9d17ab None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.040057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912af04-daa4-4581-a593-3fc7dc9d17ab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.040395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912af04-daa4-4581-a593-3fc7dc9d17ab None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.041896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 407/815] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:58.042498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912af04-daa4-4581-a593-3fc7dc9d17ab None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.066186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079e6a-6c13-4ca2-9e89-1f44213b6dd6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.102143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.103192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.103443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.103746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.104640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:58.104949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.106400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f49e-72f1-413e-a41f-c514f93f2f65 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.124393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 409/816] 10.222.0.75 () {56 vars in 1149 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:58.125708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.126021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.126295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.143665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:58.144857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:58.158412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912af04-daa4-4581-a593-3fc7dc9d17ab None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.193890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.194341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.194956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.195231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.195504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.196207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.197670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.215599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.229975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 410/817] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:58.229975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.233619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 408/818] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:41:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:58.234698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.425575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d84f0-f553-49cb-8346-834c49ae2912 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.437445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e5b2c-3655-4d86-b8f6-f920516dae16 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.469843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.470415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.470699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.471200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.480971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.482348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.483057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.483507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.483613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.484983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.496983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.498669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:58.501958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:58.502891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:58.504001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:58.504001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:58.504001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:58.504001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 411/819] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:58.509403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:58.517935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:58.518881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:58.519782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:58.519782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:58.519782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:58.522239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 409/820] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:58.530266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.556201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.603420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.648718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19760-4ff8-4ed3-b463-5bcd7165826a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.670220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d1f28-d3ce-4065-81c0-5b6e32958d08 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.694789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.695413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.695695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.696496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.697147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:58.697715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.699399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.711550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.712722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.713142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.713803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.714539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:58.714934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.715725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 412/821] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:58.716625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.721195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.739619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 410/822] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:58.740670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.821038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.830539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666aafa-3954-4229-adf0-0466a2be7790 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.847499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d70ca5-1b97-47a8-a72c-08375ffffef0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.858798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:58.869681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.870570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.871053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.871539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] PATH_INFO: `/v3/services/network` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.872309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.873923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:58.883143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:58.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:41:58.884969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:58.887765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 413/823] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:58.889352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.892744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.893393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.893668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.893964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.901893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.903297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:58.915873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:58.916827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:58.917717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:58.921845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 411/824] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:58.922836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:58.997175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c1c5c-8a5d-40f0-a089-4323ed54e294 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.030302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a293cfe-377c-4543-9713-6cec553821a5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.041688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.042581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.042995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.043398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.050798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.052465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:59.065287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:59.067492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:59.068602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:41:59.075382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 414/825] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:59.075382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.078815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.079482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.079759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.080023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.081187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:59.081187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.082486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.093731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 412/826] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.094741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.096845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.130153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.182190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3737f2-1ff2-461b-b371-1ddb0db71d23 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.204631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbeaaf-f11f-4fcf-81e9-e0fa64d55ae8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.218042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.219057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.219529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.219988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.220961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:59.221521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.223220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.237623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 415/827] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.238929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.328389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.353839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94ea16-a53a-46f5-b878-383527256558 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.379702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.380655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.381155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.381674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.382599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:59.383082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.384880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.392987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.393294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.393581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.393876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.394507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] RBAC: Adding query filter params (type=network) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:59.394808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.396325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.400340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 413/828] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.401504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.411303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 416/829] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.411303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.505834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.517298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c619e2-9f3b-4674-9ea4-cd36fac711c3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.518049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68830-171b-4132-8b8d-3badcdef7630 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.554889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.555843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.556109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.556423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.557082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b4d48e600b4d470c88bd1606ea51c263) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:59.557379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.557562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16ec6d-bb07-47b9-abcc-f88d7e054ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.558265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ec6d-bb07-47b9-abcc-f88d7e054ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.558545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ec6d-bb07-47b9-abcc-f88d7e054ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.558818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ec6d-bb07-47b9-abcc-f88d7e054ee5 None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/cc4e648a859f42a7af9117651759baba/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.558910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.574142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 414/830] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/role_assignments?user.id=b4d48e600b4d470c88bd1606ea51c263&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.574142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.579691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.589065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16ec6d-bb07-47b9-abcc-f88d7e054ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=cc4e648a859f42a7af9117651759baba, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.590569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16ec6d-bb07-47b9-abcc-f88d7e054ee5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.609595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 417/831] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:59 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/cc4e648a859f42a7af9117651759baba/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:59.611740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f18e8-132f-446b-b08b-26b20675428c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.612016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f18e8-132f-446b-b08b-26b20675428c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.612282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f18e8-132f-446b-b08b-26b20675428c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.614707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 418/832] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:59.620461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.620806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.621146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.640691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:59.642105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:59.718541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0694-09ef-4db6-b907-43a33362cc55 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.728420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 419/833] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:59.784437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.785579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.785579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.785923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.786667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.788143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.815473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 415/834] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:41:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:00.021965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.143978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7759e-9d83-457a-9b9e-cc803db8a5b9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.167190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:00.193433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b1d62-f3b2-484b-bc0e-13dd797c7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.194246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1d62-f3b2-484b-bc0e-13dd797c7069 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.194589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1d62-f3b2-484b-bc0e-13dd797c7069 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.194926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1d62-f3b2-484b-bc0e-13dd797c7069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.208255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1d62-f3b2-484b-bc0e-13dd797c7069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-887b1d62-f3b2-484b-bc0e-13dd797c7069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:00.214015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:00.215143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:00.216178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:00.221875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 420/835] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:00.224019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.250141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:00.336152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e7e5b-4336-4fb6-84fe-a7a80deee45f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.375498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.376388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.376672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.376939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.377613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:00.377938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.379325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.385494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db673b4a-74ea-4af5-8b1d-783e572b14f5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.386418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db673b4a-74ea-4af5-8b1d-783e572b14f5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.386700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db673b4a-74ea-4af5-8b1d-783e572b14f5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.388320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 421/836] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:00.391968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 416/837] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:00.393049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.393327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.393597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.397748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.412079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:00.413323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:00.476692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:00.490167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 422/838] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:00.500379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a588fe-ec98-4407-a274-67453d1a6673 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.533803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.534558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.534921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.535276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.545819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.547553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:00.562287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:00.563230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:00.564473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:00.564473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:00.564473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:00.564473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 417/839] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:00.569474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.669743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a42d71-f4f9-4f5e-8ebb-c4aa4b082aef None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.677293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:00.704770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.705377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.705646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.705949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.706591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:00.706883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.708259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.719858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 423/840] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:00.725360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.769020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.838626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd7664-f1ec-47a1-9295-7c3da99ac909 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.872737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:00.882908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.883805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.884077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.884380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.892889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.894481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.903372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5073f-6e94-4c75-a54d-07e157962810 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:00.906560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:00.907563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:42:00.908500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:00.912470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 418/841] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:00.913448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.949473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.950500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.950983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.951476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.952254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.953917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:00.963264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:00.964253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:00.965063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:00.967761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 424/842] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:00.973509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:01.005389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:01.034238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc093d-8c76-4790-ba53-7b2d95791f2c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:01.072953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:01.074054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.074540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.075017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.076028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:01.076636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:01.078271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:01.079290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227da00-8e88-4c02-a049-4e9cf5837348 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:01.103607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 419/843] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:01.104899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:01.113800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:01.114484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.114764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.115036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.115933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:01.116054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:01.117485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:01.125805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 425/844] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:01.129442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:01.161620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:01.222394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5348dd-abd3-43c0-89f4-7647deb39ec7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:01.257587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:01.258417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.258780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.259045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:01.259427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.268219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebd712-15ba-4ccd-a4b8-836ffb4e89ea None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:01.316450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:01.317330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.317757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.318226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.319571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:01.320036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:01.322143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:01.329937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 426/845] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:01.341092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:01.343005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:01.395929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:01.462651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 420/846] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:01.473750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:01.582484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69d610-d110-4114-8574-3581e08aa4e5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:01.617965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:01.618863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.619288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.619701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.632825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:01.635460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b84053c4-d7a1-477b-b1bf-cc12306ff38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:01.655306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:01.656283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:01.657173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:01.657173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:01.657173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:01.657173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 427/847] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:01.663278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:01.769895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31f88-983c-456e-b8d5-28f86bb8db8f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:01.779357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdde07-1cd8-4429-ae6c-b23283c7e30a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.779643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdde07-1cd8-4429-ae6c-b23283c7e30a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.779922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdde07-1cd8-4429-ae6c-b23283c7e30a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.781615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 428/848] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:01.786480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c278-5794-43f7-8cbd-6d8e6cdc7edb None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.786771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c278-5794-43f7-8cbd-6d8e6cdc7edb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.787034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c278-5794-43f7-8cbd-6d8e6cdc7edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.808773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:01.809413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8843c278-5794-43f7-8cbd-6d8e6cdc7edb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:01.810011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.810490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.810685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8843c278-5794-43f7-8cbd-6d8e6cdc7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:01.811135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.811987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:01.812474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:01.814066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:01.815077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:01.836467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 421/849] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:01.841862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:01.851103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:01.907240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 429/850] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:01.908537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bff83-6e56-4c70-adad-9ee5ba65f3ac None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.908818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bff83-6e56-4c70-adad-9ee5ba65f3ac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.909086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bff83-6e56-4c70-adad-9ee5ba65f3ac None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.910573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 430/851] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:01.919529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:01.919895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:01.920169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:01.943561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:01.945284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:01.964304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be55a-5ca0-4660-9f09-9d5dfdd8a4e8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.010457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.011088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.011361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.011628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.019741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.021237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.033932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 431/852] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:02.039904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:02.040843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:02.041722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 422/853] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:02.048658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.120798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.151720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e4a06-5c5f-40e9-af01-3873882a3f96 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.186320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.187360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.187858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.188318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.189202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:02.189688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.191358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.194394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.208749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 432/854] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:02.212298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.264678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.310936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56510b2-f952-4f8a-8ea5-f38e342e001f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.345932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.346647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.346908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.347170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.347456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba742e07-f4df-4da3-939c-adbd4e0021e1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.358459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:02.363905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:02.364834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:02.365676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 423/855] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:02.366895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.386643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.393619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.394332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.394602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.394795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.395507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=33b930c3607b42a5801da45336c9c009) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:02.395844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.397362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.413831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 433/856] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/role_assignments?user.id=33b930c3607b42a5801da45336c9c009&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:02.413831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.495354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab126-00ed-4284-9881-5912a15a56a8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.526069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.539033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.539773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.540162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.540527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.541210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.542777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.554422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d6a1d-873b-4f0a-a901-e92227e946ea None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:02.555060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:02.556555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:02.557671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:02.559823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 424/857] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:02.566862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.602664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.603286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.603564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.603836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.604499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:02.604806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.607205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.617186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 434/858] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:02.622748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.698977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.705546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44d82-1725-4b0e-a708-6dc41f958177 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.755386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.756962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.757504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.757945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.758962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:02.759796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.761627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.762446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b406a-6962-41a9-a082-d95d4b07f693 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.768333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 425/859] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:02.773667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.804702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.805360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.805948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.806233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.817632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.819200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:02.837935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:02.838945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:02.839824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:02.839824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:02.839824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:02.839824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 435/860] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:02.849050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.859453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.908877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d90-12a2-4cfe-941b-a9d9529adeff None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.944954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.945573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.945887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.946155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.946791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:02.947083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.949046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.957966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 426/861] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:02.987927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579c663-57ae-4bcd-9682-ea6f45073ba6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.999095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.029611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.030521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.030802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.031075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.031727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:03.032085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.033529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.057438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 436/862] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:03.058953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.165251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733fb7-f477-4250-b1d9-a663105af329 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.182921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.203301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.203928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.204195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.204459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.211929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.213377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8f9504c6-b8f3-49fc-865c-4a6b7f5c2605 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:03.225190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:03.226232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:03.227294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:03.231207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 427/863] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:03.232557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.336636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256d0e-9e5c-4405-99fe-d08e65f6b921 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.357077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c588c-c0b9-49b4-889e-48bf7c3f2c8e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.357593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c588c-c0b9-49b4-889e-48bf7c3f2c8e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.357593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c588c-c0b9-49b4-889e-48bf7c3f2c8e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.359062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 428/864] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:03.364272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.364797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.365254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.375049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.375673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.375956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.376223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.377035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:03.377343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.378943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.386239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:03.387701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:03.401723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 437/865] 10.222.0.75 () {56 vars in 1149 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:03.404625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.437999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.477818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 429/866] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:03.516168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce55b-2369-46ef-a200-e47fe30a3784 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.550818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.551712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.552125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.552539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.621373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.623115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.649332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.723481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 438/867] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:03.730914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.758798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.836607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364cffe-c786-467b-aec6-5e6580cb4be8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.844681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.875758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.876495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.876776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.877045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.883169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f9d2-5289-470a-9f8d-c17f2cc5c29b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.889150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.890805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:03.906793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:03.907766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:03.909086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:03.909086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:03.909086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:03.909086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 430/868] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:03.914530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.915429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.923689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.924309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.924590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.924860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.925523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.927145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.949865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 439/869] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:03 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:04.043635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834a575-27fb-4fdb-8828-e32e0a80576d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:04.088289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:04.088956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.089241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.089531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.090199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:04.090502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:04.091938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:04.107195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 431/870] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:04.113343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:04.225169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3ec73-206c-4dca-b44e-4966458e5102 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:04.260001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:04.260647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.260940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.261307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.269572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:04.271412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:04.284168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:04.285086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:04.286212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 440/871] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:04.291731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:04.308147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:04.392061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5eea-97da-43f9-992f-cc242be049fb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:04.425954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:04.426579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.426854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.427121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.427810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:04.428114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:04.429601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cdb6f-35b8-4c9c-86c6-7c4f8fce7be8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:04.442148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 432/872] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:04.448373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:04.501206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:04.507339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334851-8ad8-4633-8521-27865ffb5262 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.507620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334851-8ad8-4633-8521-27865ffb5262 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.507894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334851-8ad8-4633-8521-27865ffb5262 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.509239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 433/873] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:04.516389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.516389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.516389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.534411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:04.535605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:04.566070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0a18-9da5-4e88-9391-56fa05af5df0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:04.605112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 434/874] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:04.611400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:04.612024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.612303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.612575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.613300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=cc4e648a859f42a7af9117651759baba) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:04.613605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:04.615081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db7d2-d7c3-43f0-baa7-16203d7abede None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:04.621513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 441/875] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:04 2022] GET /identity/v3/role_assignments?user.id=cc4e648a859f42a7af9117651759baba&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:04.876310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:04.879589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:04.980606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472779b-0c1a-448e-ab5f-f01e1146fab4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:05.010319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f005f3-4b78-46ff-a0b5-97c472e91dda None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.010985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f005f3-4b78-46ff-a0b5-97c472e91dda None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.011470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f005f3-4b78-46ff-a0b5-97c472e91dda None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.013255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 442/876] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:05.016790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:05.017535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.017849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.018378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.019021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:05.019836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.020317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.020425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:05.020896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:05.030771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:05.031802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:05.032619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:05.035348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 435/877] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:05.041489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:05.043119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:05.044324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:05.123075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:05.130240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 443/878] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:05.162905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c50f3-0643-47c2-b7f2-8277ee112fed None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:05.198066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:05.198681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.198954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.199219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.199841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:05.200138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:05.201501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:05.206611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 436/879] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:05.212334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:05.270262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:05.315860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157bb5-f89b-4fa1-8c43-be57d5bffe8a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:05.349621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:05.350266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.350570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.350845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.351479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:05.351776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:05.353150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316b6c0-2658-436e-a948-f8bc44e2aef8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:05.358112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 444/880] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:05.423723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:05.538173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f0e35-88cb-499e-8a4c-1f5eb9e2fd36 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:05.568856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:05.575672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd33769-43f9-4b30-a1f1-8f9425093394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:05.576571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd33769-43f9-4b30-a1f1-8f9425093394 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.577039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd33769-43f9-4b30-a1f1-8f9425093394 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.577521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd33769-43f9-4b30-a1f1-8f9425093394 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.578437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd33769-43f9-4b30-a1f1-8f9425093394 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:05.579994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd33769-43f9-4b30-a1f1-8f9425093394 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:05.599817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 437/881] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:05 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:05.979123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21156a8-a678-4c3a-8ebd-de7991067192 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.979637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21156a8-a678-4c3a-8ebd-de7991067192 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.979713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21156a8-a678-4c3a-8ebd-de7991067192 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:05.981439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 445/882] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:05.986832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:05.987116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:05.987387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.005467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:06.006911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:06.085956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 438/883] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:06.342875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21156a8-a678-4c3a-8ebd-de7991067192 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:06.449604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21156a8-a678-4c3a-8ebd-de7991067192 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:06.451971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:06.484802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:06.485445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:06.485725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:06.486032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.486842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:06.488258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-86a87c28-ed8f-4d77-ab43-d0c769946533 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:06.498377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:06.499416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:06.500269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 446/884] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:06.505993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:06.609884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a3bff-0bf9-411d-b740-65048f685fb3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:06.628082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:06.646078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:06.646961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dc863-0001-4d14-b082-16f35578d45a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:06.647231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:06.647333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dc863-0001-4d14-b082-16f35578d45a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:06.647528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dc863-0001-4d14-b082-16f35578d45a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.648033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:06.648489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.649154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 447/885] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:06.649522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:06.650051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:06.651740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:06.654110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:06.654307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:06.654537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.658024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 439/886] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:06.667609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:06.672735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:06.673957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:06.755194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 448/887] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:06.779961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0c391-2305-41f3-9870-a6a5e04245e3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:06.815775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:06.816729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:06.817288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:06.817743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.818587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:06.819086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:06.820720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:06.829907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 440/888] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:06.834889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:06.934842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:06.939298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c88f5-8dba-45a3-8976-b41636f6f2dd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:06.973888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:06.974498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:06.974768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:06.975030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:06.975762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] RBAC: Adding query filter params (interface=public, service_id=61f6fb67e6ad4c69806e1a1efab63a11, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:06.976065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:06.977436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:06.986791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 449/889] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:42:06 2022] GET /identity/v3/endpoints?service_id=61f6fb67e6ad4c69806e1a1efab63a11&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:06.988979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.034532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.041189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:07.102896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76053ce-2751-4cfd-9bad-ba06464afa2d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.144308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.144914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.145186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.145479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.146085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.147452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.162202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 441/890] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:42:06 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:42:07.167819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1435079-b667-47bb-bdf4-fbee8dd146ce None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.209209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa21a-3ac5-4f4e-8782-6a5bd1995b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.210343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa21a-3ac5-4f4e-8782-6a5bd1995b55 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.210879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa21a-3ac5-4f4e-8782-6a5bd1995b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.211337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa21a-3ac5-4f4e-8782-6a5bd1995b55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.223996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fa21a-3ac5-4f4e-8782-6a5bd1995b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-6a9fa21a-3ac5-4f4e-8782-6a5bd1995b55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:07.229353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:07.230317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:07.231164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:07.234050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 450/891] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:07.245817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.345700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d75491-e1fc-4b91-80c6-f4b8974181e5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.346046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d75491-e1fc-4b91-80c6-f4b8974181e5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.346286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d75491-e1fc-4b91-80c6-f4b8974181e5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.348440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 451/892] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:07.353553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c8ed-29f1-4b0f-a6c1-ad837228b716 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.353844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c8ed-29f1-4b0f-a6c1-ad837228b716 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.354121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c8ed-29f1-4b0f-a6c1-ad837228b716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.357948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62b97-de60-41b6-80ec-00fc522e10af None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.369862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:07.383109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-21a6c8ed-29f1-4b0f-a6c1-ad837228b716 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:07.384446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-21a6c8ed-29f1-4b0f-a6c1-ad837228b716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:07.402492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:07.408709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.409330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.409605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.409947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.410859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:07.411158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.412694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.423897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 442/893] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:07.429506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.463114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 452/894] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:07.536003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f16bb3-ad62-4f7f-a99f-1d2be12c78fc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.571434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.572078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.572353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.572624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.578556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb882d7-3cba-411b-bda2-41cf635f4151 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.578844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb882d7-3cba-411b-bda2-41cf635f4151 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.579122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb882d7-3cba-411b-bda2-41cf635f4151 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.580720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 453/895] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:07.584350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.585742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.585951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.586051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.586321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:07.600963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:07.602153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:07.603285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:07.603285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:07.603285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:07.604970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:07.605140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 443/896] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:07.609870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:07.610961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.638201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:07.681706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 454/897] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:07.717567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327bbf9-c336-44bf-acfc-595eed4d55a7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.752246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.753117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.753541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.753986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.754766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:07.755210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.756719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.760596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.769188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 444/898] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:07.774848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.854167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:07.870043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:07.871547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b91a5-33d7-4c01-bcb6-8e80b2777561 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.887424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7439a4-f5b3-4d71-87e1-63fac25bf72b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.907259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.908148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.908647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.909122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.910005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.911602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.923633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.924311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.924637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.924961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.933956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 455/899] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:07 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:42:07.935321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.936908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:07.950541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:07.951534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:07.952578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 445/900] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:07.958082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.962874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.086808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7261f2-c895-4aeb-8f80-2afeeb082542 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.095456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5dd7-a0dc-49bc-8eac-7b77caed2431 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.123998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.124612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.124927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.125200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.127406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:08.127406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.127798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.138614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:08.142844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.143858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.144327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.144799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.145750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.147161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.149880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 456/901] 10.222.0.75 () {56 vars in 1149 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:08.156671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:08.159696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:08.160612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:08.161491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 446/902] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:08.166722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.179242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:08.283961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efba0d-58da-43c7-889f-96138aeffae4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.284167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0ee2-b611-4ada-bda2-bdee0ea5eab0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.321763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.322423 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.322696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.322971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.328769 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.329374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.329654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.329969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.330601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:08.330892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.332699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.339554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 447/903] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:08.345348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.402211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:08.410643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.412875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.424708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:08.466705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad9766-6d5f-44c9-ab55-0d5fa254ce01 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.512833 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.513727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.514196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.514997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.515774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:08.516446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.518436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.525492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 448/904] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:08.532300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 457/905] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:08.533411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.538929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.640932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcad247-2632-42e8-aa6b-f19f1803d129 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.651437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:08.659429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecfaf7-397f-41a8-80b1-31ea46bb71d0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.683935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.685113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.685679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.686208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.687185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] RBAC: Adding query filter params (interface=public, service_id=f724b5daa8fd472a8deeb1ad621fe233, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:08.687634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.689719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.695275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:08.697209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.698238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.699025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.699532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.703241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 449/906] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/endpoints?service_id=f724b5daa8fd472a8deeb1ad621fe233&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:08.704478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.712895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.714729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:08.730748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:08.731738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:08.732629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:08.732629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:08.732629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:08.739260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 458/907] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:08.740341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.824262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13593-fcad-4798-96cd-b60f2c5fcd74 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.848075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c66b97-90e1-424e-85c2-d7db2f1ce679 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:08.862257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.862869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.863142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.863411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.864013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.865380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.871637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 450/908] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:42:08.888771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:08.889961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:08.890487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:08.891050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:08.891913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:08.892433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:08.894083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:08.909098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 459/909] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:08.915355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:08.989322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:09.031045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28e1c-ef62-4dc6-92fc-9a420289720b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:09.068128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:09.068859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.069136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.069399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.077553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:09.079106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e76964a1-f35a-43a2-b40a-5cd2d88e5ace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:09.091408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:09.092392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:09.093277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 451/910] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:09.100219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:09.111781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:09.166394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de408-226b-4cfb-8250-9d34c3252036 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.166952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de408-226b-4cfb-8250-9d34c3252036 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.167398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de408-226b-4cfb-8250-9d34c3252036 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.169194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 452/911] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:09.173936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.174218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.174487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.194794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:09.195997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:09.215314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42e8e7-ad9c-4951-90de-1b08575e2697 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:09.258884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:09.259504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.259785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.260077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.261299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:09.261607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:09.263304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:09.265468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 453/912] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:09.280094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 460/913] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:09.285898 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:09.343256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:09.391238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cedb72-e864-4e90-b986-e0f095b2003b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:09.430144 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:09.430673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.430949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.431535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.432252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] RBAC: Adding query filter params (role.id=6bc7457c4151474cb68e5bb34f24ab1e, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=cc4e648a859f42a7af9117651759baba) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:09.432554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:09.434066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:09.439951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 454/914] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:09 2022] GET /identity/v3/role_assignments?user.id=cc4e648a859f42a7af9117651759baba&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=6bc7457c4151474cb68e5bb34f24ab1e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:09.580369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:09.649900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:09.684532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43dfb-7622-4992-baa5-3e59ca250a54 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:09.718429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:09.719065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.719341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.719618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.720196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:09.721576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:09.730648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:09.731621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:09.732445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 461/915] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:09.738016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:09.852706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6c16d-d3a4-4eff-bef8-d86bd901f0a6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:09.870165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:09.888076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:09.888688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.888959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.889349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.890010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:09.890307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:09.891681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166055d-953f-44ad-bd87-efd6b57b98bd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:09.897254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 455/916] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:09.902908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:09.915338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863ea0-c5dc-4d2f-92e0-bd47f8f06731 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.915620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863ea0-c5dc-4d2f-92e0-bd47f8f06731 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.915883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863ea0-c5dc-4d2f-92e0-bd47f8f06731 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.917478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 456/917] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:09.922535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:09.922814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:09.923087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:09.941394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:09.942531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:10.019115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee6576-310d-4b1b-a1cd-1b10d0bdc767 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:10.021872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 457/918] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:10.058972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:10.059695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.060047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.060385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.061089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:10.061510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:10.063061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:10.068863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 462/919] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Aug 31 10:42:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:10.069398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:10.074645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:10.173444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6aef5-6a84-4445-9aac-e71aa05e49cb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:10.187044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:10.208250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:10.208785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.209055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.209319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.210021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:10.211404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:10.232977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 458/920] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:42:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:10.299906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:10.414963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c247a-8f44-48fc-8097-81d75211931e None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:10.460301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:10.460926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.461201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.461468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.462072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:10.463436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:10.472649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:10.473654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:10.474539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 463/921] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:10.480001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:10.588877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e4d5-5c57-4942-840e-b22ffefcff53 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:10.622853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:10.623472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.623745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.624014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.624648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:10.624945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:10.626349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:10.631585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 459/922] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:10.638885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:10.697697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:10.743365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310c9e-2b68-409f-9114-c8aade284188 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:10.779724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:10.780341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.780618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.780891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.781524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:10.781851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:10.783279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d72a4c-dbaf-42a8-9c7f-f1904830b1db None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:10.792094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 464/923] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:10.794997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:10.834949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:10.878912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f6a7-d2c5-4a20-b156-654af1c3e528 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.879234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f6a7-d2c5-4a20-b156-654af1c3e528 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.879487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f6a7-d2c5-4a20-b156-654af1c3e528 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.881064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 465/924] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:10.886171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.886446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.886717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.904642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:10.905875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:10.914722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3479f4-6162-4c81-8cb5-b94473bbf2e9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:10.964200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:10.964992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:10.965276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:10.965887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:10.966883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] RBAC: Adding query filter params (interface=public, service_id=31b28c53944b402682893943f3a0746d, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:10.967197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:10.969046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:10.980487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 460/925] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:42:10 2022] GET /identity/v3/endpoints?service_id=31b28c53944b402682893943f3a0746d&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:10.981824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:10.982076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 466/926] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:11.079251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:11.085864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33ee7b-eaa4-4f54-94b9-a5a44476b46c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:11.119796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:11.120404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.120680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.120946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.121545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:11.123094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:11.133896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 461/927] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:42:10 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:42:11.245721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:11.298449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:11.353313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba018c98-059d-4ded-af94-2f2b36ffceb6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:11.387316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:11.387957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.388234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.388508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.389092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:11.390607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e67ad9a4-3d75-4393-8908-4f766cc1b438 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:11.399376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:11.400319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:11.401190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 467/928] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Aug 31 10:42:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:11.407148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:11.414927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c9439-9785-4457-895b-25e41411c51e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.415199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c9439-9785-4457-895b-25e41411c51e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.415477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c9439-9785-4457-895b-25e41411c51e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.417052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 468/929] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:11.421867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.422154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.422427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.441150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:11.442365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:11.527504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac304a-ea50-4353-ad1c-d620713430f5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:11.529820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 469/930] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:11.574290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:11.575678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.576550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.577293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.578812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:11.579628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:11.581716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:11.587616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 462/931] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:11.593576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:11.654244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:11.694655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206ce6d-71a2-42ef-ba40-cd017b990a1e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:11.728407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:11.729064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.729343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.729607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.730304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:11.730601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:11.731968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:11.737241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 470/932] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:11.742932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:11.769381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:11.807404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:11.865010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d581b6-a8ff-4828-9d01-638030d670a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:11.901534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:11.902440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.902899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.903308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:11.904150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:11.905868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:11.930043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 463/933] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:42:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:42:11.946397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b69103-4c63-4932-aa2c-20b0d2c064c7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:11.958662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:11.994832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:11.995976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:11.996644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:11.997130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.010772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:12.016825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:12.018296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:12.019169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.021954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 471/934] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Aug 31 10:42:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:12.029859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.121630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:12.143780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b03dd-2dd6-4d8e-8e1f-470a2e1012da None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:12.179768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:12.180398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.180670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.180983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.182039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:12.182331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:12.183711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5556c-12bd-45cf-95b2-28ce5b0de4d4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:12.197888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 464/935] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:12.200070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.307434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419055-7c81-4cdb-9fbc-febff131a9b5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:12.312297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11822e-7081-4a03-a313-8e09ec3e12ba None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.312583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11822e-7081-4a03-a313-8e09ec3e12ba None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.312859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11822e-7081-4a03-a313-8e09ec3e12ba None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.315572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 465/936] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:12.319636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.319943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.320263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.340096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:12.342011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:12.346653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:12.347575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.348040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.348501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.359908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:12.362373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:12.378820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:12.379781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:12.380665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:12.380665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:12.380665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.382960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 472/937] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:12.390736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.409274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:12.421351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 466/938] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:12.492316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eacd9-a4b5-4bc7-a24a-cd66d60381b9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:12.526061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:12.527048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.527541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.528029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.528798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:12.529102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:12.530643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:12.549498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 473/939] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:12.554225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.625308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:12.656993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682a0d-9c1e-4ac5-a1cc-2e8b260115e0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:12.692404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:12.693473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.693997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.694501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.698018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.702981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:12.704789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:12.717959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:12.718873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:12.719796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:12.722033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 467/940] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:12.727946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.793309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:12.832814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d73c70-d310-47f5-93a6-2fb71442ec8b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:12.846219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33697de-9f6c-40f5-9be1-36ea58b62efb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:12.878244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:12.879116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.879532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.879974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.880768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:12.882398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:12.884746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:12.886069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING keystone.server.flask.common [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:42:12.892393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:12.893006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:12.893381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:12.893677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:12.894447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:12.894746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:12.896222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:12.909471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.sql.core [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:42:12.909471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:42:12.909471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [parameters: {'id': '508cad819c3043f1862de62e57af2021', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:42:12.909471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81483) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 508cad819c3043f1862de62e57af2021.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 508cad819c3043f1862de62e57af2021. Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:42:12.916903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 10:42:12.917745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application yield resource Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise self.value Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application session.commit() Aug 31 10:42:12.918738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:42:12.919620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:42:12.920512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application result.read() Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:42:12.923387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [parameters: {'id': '508cad819c3043f1862de62e57af2021', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.925639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:12.927864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 508cad819c3043f1862de62e57af2021. Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 474/941] 10.222.0.75 () {60 vars in 1140 bytes} [Wed Aug 31 10:42:12 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:12.931025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:12.940521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 468/942] 10.222.0.75 () {56 vars in 1149 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:12.947541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.044738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ef29-942c-4cfd-bc91-53724432976b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.077927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.083173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cd852-53ec-457b-b35c-92db140ca4e8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.091416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.092895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.093353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.093850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.106737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.109526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.127274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.128079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.128443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.128779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-d6ec3a20-a826-4a61-90a4-7d08c640fd09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:13.129482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:13.130730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:13.131886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:13.134063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 475/943] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:13.135993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023284c-fb5e-4881-9b3f-921f2b0a6501 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.136429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023284c-fb5e-4881-9b3f-921f2b0a6501 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.136863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023284c-fb5e-4881-9b3f-921f2b0a6501 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.141984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 476/944] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:13.142709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023284c-fb5e-4881-9b3f-921f2b0a6501 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.143427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.145086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-602b3044-676c-4479-aeee-fb3da7a0679b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:13.160544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:13.161529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:13.162468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:13.162468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:13.162468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:13.162468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 469/945] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:13.163330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.163676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.164082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.183256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:13.184463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:13.227092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.261999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023284c-fb5e-4881-9b3f-921f2b0a6501 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.265994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 470/946] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:13.265994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.301581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.302294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.302499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.302753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.303590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:13.303890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.305665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.326303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 477/947] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:13.383270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1d36d-600d-4c13-94bd-1a3a3cdd0a39 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.421214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.422149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.422590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.423022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.423838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:13.424302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.425917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.439651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 471/948] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:13.445800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.504618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.554718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.555220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b46760-1b80-4175-95ed-4056b3681a55 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.596061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.597669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.598448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.598764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.599048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.609743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.610879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:13.623610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:13.624517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:13.625391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 478/949] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:13.633677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.681941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dde62-df05-44b5-a9d0-d631e572c8db None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.716988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.717653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.717975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.718247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.718834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.720355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:13.729743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:13.730809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:13.731665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 472/950] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:13.736881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.765927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebadb-70c2-424f-a6fc-000a73369a15 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.782626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.813484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.814449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.814953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.815381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.816729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:13.817182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.819196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.834335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 479/951] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:13.840345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.851996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.861826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc558b0-a107-4abe-a06d-fb5f08a4a715 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:13.900605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:13.902055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:13.902683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:13.903178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:13.904031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:13.904682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:13.906309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:13.916470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 473/952] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:13.917423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:13.962698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083739-8cb3-4538-9ad9-e1c40c44539c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:14.003037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c420fa9-b839-43e6-a478-53ed86d80c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:14.003706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420fa9-b839-43e6-a478-53ed86d80c1e None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.003985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420fa9-b839-43e6-a478-53ed86d80c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.004255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420fa9-b839-43e6-a478-53ed86d80c1e None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/cc4e648a859f42a7af9117651759baba/roles/6bc7457c4151474cb68e5bb34f24ab1e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.006682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420fa9-b839-43e6-a478-53ed86d80c1e None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=cc4e648a859f42a7af9117651759baba, role_id=6bc7457c4151474cb68e5bb34f24ab1e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:14.008005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420fa9-b839-43e6-a478-53ed86d80c1e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:14.021473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505e19d-66e2-4395-8dea-6dbbb3b3e869 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:14.029794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 480/953] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:42:13 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/cc4e648a859f42a7af9117651759baba/roles/6bc7457c4151474cb68e5bb34f24ab1e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:42:14.029794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a0c6-c986-4b7a-bdab-ff947ccae804 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.029794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a0c6-c986-4b7a-bdab-ff947ccae804 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.029794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a0c6-c986-4b7a-bdab-ff947ccae804 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.029794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 481/954] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:14.032615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.032615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.032615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.053034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:14.055077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:14.067279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:14.067988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.068363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.068745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.069458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:14.069842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:14.071462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:14.077616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 474/955] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:14.083404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:14.090533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:14.119308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:14.142723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 482/956] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:14.214121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf7cd-c34b-4049-8dc3-d009cf91d027 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:14.249078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:14.249687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.249988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.250276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.250917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:14.252344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:14.276424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 475/957] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:42:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:42:14.421509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:14.524235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c01df-7190-4077-9b9d-31611a54eadc None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:14.569363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:14.570041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.570417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.570681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.571254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:14.572671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:14.581595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:14.582711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:14.583612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:14.586642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 483/958] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:14.589104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:14.673074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:14.694110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6645-bee5-4c53-8a36-7766f16b6f6e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:14.728840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:14.729450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.729722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.730022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.730646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:14.730941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:14.732305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ccd59-598e-4667-8ba1-bfe06d9f3269 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:14.741763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 476/959] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:14.743168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:14.767609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:14.853648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99d4ad-17ed-4b9c-ad35-dda1164fa708 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:14.887971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:14.888933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:14.889542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:14.890041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:14.890885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:14.891383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:14.892960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded7136-f339-4271-be2c-7713a92791e4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:14.898258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 484/960] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:15.386064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316ac4-a6ec-4b5b-8f76-581cf02e77c8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:15.386662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316ac4-a6ec-4b5b-8f76-581cf02e77c8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:15.386662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316ac4-a6ec-4b5b-8f76-581cf02e77c8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:15.388205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 477/961] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:15.393789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a193-774c-43cf-b953-d8165d11169d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:15.394083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a193-774c-43cf-b953-d8165d11169d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:15.394352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a193-774c-43cf-b953-d8165d11169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:15.412865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4855a193-774c-43cf-b953-d8165d11169d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:15.414132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4855a193-774c-43cf-b953-d8165d11169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:15.481131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 485/962] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:15.751349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316ac4-a6ec-4b5b-8f76-581cf02e77c8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:15.855616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316ac4-a6ec-4b5b-8f76-581cf02e77c8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:15.894526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:15.895145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:15.895420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:15.895684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:15.896338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:15.897788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:15.900358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING keystone.server.flask.common [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:42:15.913946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.sql.core [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:42:15.913946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:42:15.913946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [parameters: {'user_id': 'e7c05c090bc244b0ae5cc31970a28d07', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:42:15.913946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81484) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-710f1243-17b1-48c2-83e0-f10c18a7f87c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application result.read() Aug 31 10:42:15.931522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:42:15.932853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application yield resource Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise self.value Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application session.commit() Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:42:15.933849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:42:15.934772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:42:15.935680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application result.read() Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:42:15.936571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e7c05c090bc244b0ae5cc31970a28d07', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:15.937397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 10:42:15.939847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:15.942317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 478/963] 10.222.0.75 () {60 vars in 1131 bytes} [Wed Aug 31 10:42:15 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:15.942823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855a193-774c-43cf-b953-d8165d11169d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:15.974632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:15.998914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcca68-c192-4378-a2c4-cb0670af1d92 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:15.999191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcca68-c192-4378-a2c4-cb0670af1d92 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:15.999463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcca68-c192-4378-a2c4-cb0670af1d92 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.004229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 479/964] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:16.010652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.010930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.011246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.025985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:16.032839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:16.035021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:16.054035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855a193-774c-43cf-b953-d8165d11169d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:16.090719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:16.091868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.092346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.092805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.100780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:16.102758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:16.115081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 480/965] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-816b8c4c-2f21-4356-9ec5-8801dc8a59da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:16.115462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:16.116383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:42:16.117350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:16.120359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 486/966] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:16.130770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:16.228987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09c92-475e-48fa-8d28-b2203bab04e4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:16.263062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:16.263594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.263869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.264136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.264835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:16.265131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:16.266777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64f93b-de55-41bd-b95a-a043e3d0c470 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:16.277781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:16.303217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 481/967] 10.222.0.75 () {56 vars in 1101 bytes} [Wed Aug 31 10:42:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:16.349584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95a44-d051-4e9b-a3b6-3935b90eb964 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.349962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95a44-d051-4e9b-a3b6-3935b90eb964 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.350143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95a44-d051-4e9b-a3b6-3935b90eb964 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.351788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 487/968] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:16.357563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.357947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.358129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.377724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:16.378967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:16.397741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95a44-d051-4e9b-a3b6-3935b90eb964 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:16.473863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 482/969] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:16.492479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:16.520919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95a44-d051-4e9b-a3b6-3935b90eb964 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:16.557605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:16.558296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.558571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.558842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.570623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:16.575630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:16.576573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:16.577406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 488/970] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Aug 31 10:42:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:16.583022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:16.686154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06340a-e467-4f2a-a62a-cd7c09682020 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:16.711368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:16.723633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:16.724255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.724529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.724796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.725459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:16.725794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:16.727256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:16.735753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 483/971] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:42:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:16.741596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:16.746789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:16.857290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa74d8-a555-454a-900d-2e34561d1323 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:16.870312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4a3b-0376-4e44-b360-e8186ad12294 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:16.894455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:16.895474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.895818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.896095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.898887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:16.907128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:16.907847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.908126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.908394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.908487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:16.908980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:16.909964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:16.910402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cd72c0cc-befd-4740-8ef0-edaa4b65c7e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:16.919310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:16.921951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:16.922806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 484/972] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:16.923629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af343-8032-45e0-8668-d85029bcbce8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.923629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af343-8032-45e0-8668-d85029bcbce8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.923629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af343-8032-45e0-8668-d85029bcbce8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.923824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 485/973] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-cb67d992-caca-455c-81c1-3e50e78779e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:16.924291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:16.925807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:16.927239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:16.927239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:16.927239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:16.927239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 489/974] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:16.927477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128af343-8032-45e0-8668-d85029bcbce8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:16.930797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:16.931082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:16.931353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:16.949355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:16.950577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:16.978414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.016898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 490/975] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:17.018030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.031956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128af343-8032-45e0-8668-d85029bcbce8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.067001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.067621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.067896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.068164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.068893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:17.069196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.070674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.075827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 486/976] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:17.081301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.117366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d191c1c-037d-4cb3-99a7-b56318f3ed9c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.134584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.152766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.153380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.153653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.153968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.154635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:17.154922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.156327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.168275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 491/977] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:17.173703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.188114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902ead4-722c-4821-9f8e-216fe9589619 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.202547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.225512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.226538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.226983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.227398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.228295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:17.228736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.230461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.240968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 487/978] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:17.241991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.274558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7446715-c3a8-46cf-abb7-68e5da7296b1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.308076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.308708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.308986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.309258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.316540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.317997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:17.329168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:17.330144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:42:17.331107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:17.335089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 492/979] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:17.335776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.344122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b6ac5-181f-4579-a610-c16857f798e3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.374942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.377940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.378555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.378831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.379097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.379807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] RBAC: Adding query filter params (interface=admin, service_id=31b28c53944b402682893943f3a0746d, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:17.380115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.381508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.386810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 488/980] 10.222.0.75 () {56 vars in 1249 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/endpoints?service_id=31b28c53944b402682893943f3a0746d&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:17.387383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.430694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.439839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37369-7dfc-4c02-a1e6-b41e1ebf6438 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.472617 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.473229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.473505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.473793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.474465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.475862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.488400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b2f62-0223-4b84-bc9d-dcfac460e228 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.491147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 493/981] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:17 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:17.491787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.538170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.539090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.539430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.539699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.540479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:17.540827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.542308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.562347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 489/982] 10.222.0.75 () {56 vars in 1149 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:17.568665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:17.611838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.618024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95e427-16f4-4257-ac44-97e1be51cdec None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.659212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.659875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.660265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.660540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.661154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.662582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.669945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 494/983] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:42:17.688539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.695485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9ba4c-b035-4a47-b11e-8bdb87d9307e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:17.735112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:17.735754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:17.736029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:17.736297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:17.813868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:17.815391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:17.923588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.932715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 490/984] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:17.938469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:18.042086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceace4c-91d4-4780-be33-7add401cd8d3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:18.077814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:18.078447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:18.078698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:18.078998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:18.090187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:18.091659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:18.106728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:18.107722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:18.108648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:18.108648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:18.108648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:18.108648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 495/985] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:18.115298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:18.221423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49511-bed4-4113-a508-44604bb91e74 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:18.257723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:18.258588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:18.258866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:18.259132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:18.259776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:18.260073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:18.261489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:18.279226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 491/986] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:18.280252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:18.301159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:18.388897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c984b4-39ac-4022-a98b-889ae53a60bb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:18.422871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:18.423500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:18.423781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:18.424049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:18.430829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:18.432609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:18.444160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:18.445005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:18.445961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 496/987] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:18.452244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:18.510610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:18.557599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce43dfc-d019-4b75-a565-0555c13087fc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:18.591457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:18.592063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:18.592336 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:18.592603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:18.593291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:18.593591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:18.595045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7886360-066d-41ca-813b-97e7be4e9472 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:18.611962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 492/988] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:18.613468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:18.695329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:18.722847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eafbcb-45c1-4b98-ab80-0c586ba92d2c None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:18.758357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:18.759393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:18.759883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:18.760351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:18.761403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] RBAC: Adding query filter params (role.id=6bc7457c4151474cb68e5bb34f24ab1e, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=cc4e648a859f42a7af9117651759baba) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:18.761990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:18.763662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1d9c0-df99-4334-a13d-a27aed51e2e8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:18.777809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 497/989] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:18 2022] GET /identity/v3/role_assignments?user.id=cc4e648a859f42a7af9117651759baba&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=6bc7457c4151474cb68e5bb34f24ab1e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:19.446863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35b7b-0d50-4a4d-8b7f-3370725cdcbb None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:19.447123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35b7b-0d50-4a4d-8b7f-3370725cdcbb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:19.447393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35b7b-0d50-4a4d-8b7f-3370725cdcbb None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:19.448796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 493/990] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:19.454672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085e006-51f8-4ca7-b354-82936ec2d293 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:19.455131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085e006-51f8-4ca7-b354-82936ec2d293 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:19.455224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085e006-51f8-4ca7-b354-82936ec2d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:19.473902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9085e006-51f8-4ca7-b354-82936ec2d293 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:19.475129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9085e006-51f8-4ca7-b354-82936ec2d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:19.547441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 498/991] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:19.585623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf698a9d-b950-4c37-ac42-0ac875751303 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:19.586148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf698a9d-b950-4c37-ac42-0ac875751303 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:19.586326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf698a9d-b950-4c37-ac42-0ac875751303 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:19.587789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 494/992] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:19.592979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:19.593260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:19.593532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:19.612593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:19.613738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:19.681464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:19.690155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 499/993] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:19.814288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf698a9d-b950-4c37-ac42-0ac875751303 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:19.931334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf698a9d-b950-4c37-ac42-0ac875751303 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:19.948477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:19.948764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:19.967571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:19.968211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:19.968464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:19.968725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:19.969296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:19.970684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:19.979433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:19.980405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:19.986556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 495/994] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:19.987704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.068497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33e8b-d78a-4087-b123-21be0d8518a7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.091002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb62de-3e7f-4472-9713-3683a57c4d67 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.102442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.103336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.103616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.103888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.104472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.105881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:20.115770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:20.116771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:20.117687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 500/995] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Aug 31 10:42:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:20.122859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.128615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.129225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.129504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.129844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.130481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:20.130780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.132152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.138043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 496/996] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:20.143607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.188103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:20.193450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:20.232951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf145c-6feb-4b1c-bd17-68d45a9a1e0a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.247716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cb8ae-bfb8-43ee-9d03-4d9634656caf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.270103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.271027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.271410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.271764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.272516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:20.272934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.274429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.280002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 501/997] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:20.284641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.285045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.285314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.285504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.285611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.286223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:20.286521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.287887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.293484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 497/998] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:20.299342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.395472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9e31-a587-4833-8601-ef33008ec48f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.401041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5f9a-b65b-4160-b869-d04b19f28532 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.411265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:20.423535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:20.433795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.434432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.434711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.434984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.435610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:20.435963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.437345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.440064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.440904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.441366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.441849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.442377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 502/999] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Aug 31 10:42:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:20.442912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] RBAC: Adding query filter params (interface=public, service_id=f1d97bb79e134025bdfd6f39f2f6344f, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:20.443221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.444583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.448222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.452554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 498/1000] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:42:20 2022] GET /identity/v3/endpoints?service_id=f1d97bb79e134025bdfd6f39f2f6344f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:20.457862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:20.551971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b07eb5-d49a-4af5-a40a-c302cddefd99 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.566431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e858e-3840-4044-b449-b1a426e5b192 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:20.590489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cb4a-6c80-42da-8091-00f0a34f088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.591109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cb4a-6c80-42da-8091-00f0a34f088f None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.591534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cb4a-6c80-42da-8091-00f0a34f088f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.591815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cb4a-6c80-42da-8091-00f0a34f088f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.592797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817cb4a-6c80-42da-8091-00f0a34f088f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.594363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817cb4a-6c80-42da-8091-00f0a34f088f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.600394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3abc5e-9fcd-46fe-b7c6-c359f7e20c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:20.602135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3abc5e-9fcd-46fe-b7c6-c359f7e20c38 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.602756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3abc5e-9fcd-46fe-b7c6-c359f7e20c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.603003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3abc5e-9fcd-46fe-b7c6-c359f7e20c38 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.603650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3abc5e-9fcd-46fe-b7c6-c359f7e20c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:20.605224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3abc5e-9fcd-46fe-b7c6-c359f7e20c38 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:20.617869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 499/1001] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:42:20 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:42:20.618105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 503/1002] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:42:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:42:20.684974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebb96b-47ac-4ffe-8e68-3191f521779b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.685252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebb96b-47ac-4ffe-8e68-3191f521779b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.685499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebb96b-47ac-4ffe-8e68-3191f521779b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.687212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 500/1003] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:20.693034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:20.693368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:20.693581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:20.713716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:20.714990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:20.771428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:20.801755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 504/1004] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:21.061594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebb96b-47ac-4ffe-8e68-3191f521779b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:21.101356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:21.171037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebb96b-47ac-4ffe-8e68-3191f521779b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:21.211959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:21.212591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:21.212862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:21.213178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:21.213803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:21.215204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:21.224635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:21.225788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:21.227508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 501/1005] 10.222.0.75 () {56 vars in 1105 bytes} [Wed Aug 31 10:42:21 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:21.231693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:21.334379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8dc3-88fa-4e28-a663-2e4221fcb2a9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:21.372364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:21.374227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:21.374603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:21.374974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:21.375730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] RBAC: Adding query filter params (name=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:21.376124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:21.377614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096da70e-88f4-4065-ba1f-d9f434f66585 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:21.383014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 505/1006] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:21.388692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:21.492155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:21.496083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401663b2-e075-4a88-9d1c-e725656823d4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:21.531007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:21.531770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:21.532143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:21.532509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:21.533260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] RBAC: Adding query filter params (type=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:21.533657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:21.535146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd8c6-1fc8-4dcc-b580-1b16147a4441 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:21.540319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 502/1007] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:22.568723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f11f85-ae09-420b-a7f9-a592b8c64b58 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:22.569268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f11f85-ae09-420b-a7f9-a592b8c64b58 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:22.569268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f11f85-ae09-420b-a7f9-a592b8c64b58 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:22.570602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 506/1008] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:22.576045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a7c4b-5b25-4851-90ce-379f1bd55029 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:22.576458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a7c4b-5b25-4851-90ce-379f1bd55029 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:22.576662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a7c4b-5b25-4851-90ce-379f1bd55029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:22.595449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-be0a7c4b-5b25-4851-90ce-379f1bd55029 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:22.596640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-be0a7c4b-5b25-4851-90ce-379f1bd55029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:22.671705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 503/1009] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:22.684306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65348-f721-49e1-8a8d-aa826729cd27 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:22.684554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65348-f721-49e1-8a8d-aa826729cd27 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:22.684846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65348-f721-49e1-8a8d-aa826729cd27 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:22.686369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 507/1010] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:22.691424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:22.691702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:22.691966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:22.710255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:22.711427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:22.777863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 504/1011] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:22.936882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe65348-f721-49e1-8a8d-aa826729cd27 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:22.983760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:23.042399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:23.044888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe65348-f721-49e1-8a8d-aa826729cd27 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.067936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:23.086411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.087107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.087383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.087961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.088222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.089615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:23.098715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:23.099687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:23.101448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 508/1012] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:23.105862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:23.148901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c64c2-f14f-480b-915a-f08f10245765 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.182750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.183376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.183663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.183929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.185050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.186501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.192864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 505/1013] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:23.193615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:23.210301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c732edf-bd19-4402-a258-3aae1a306248 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.212683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:23.246176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.246785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.247064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.247331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.247950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:23.248264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.249623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.256043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 509/1014] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:23.261840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:23.285127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:23.295719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22514374-efe6-4248-8e84-93af961e4d1d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.330654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.331282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.331555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.331831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.332441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.333882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.365890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 506/1015] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:23 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:23.374209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf9fc-8836-4a55-8a9b-f6c7aec85b67 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.412677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.413323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.413590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.413898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.414533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:23.414896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.416317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bdfe7-a9ec-4293-99e4-ada9a8861c0f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.422240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 510/1016] 10.222.0.75 () {56 vars in 1112 bytes} [Wed Aug 31 10:42:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:23.427958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:23.442054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d816-fcee-4760-b7d9-ff45464aea20 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.442643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d816-fcee-4760-b7d9-ff45464aea20 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.443146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d816-fcee-4760-b7d9-ff45464aea20 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.444907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 511/1017] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:42:23.451434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.451745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.451977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.471140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:23.472371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:23.501232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:23.542678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d1c12-037c-4555-8b9b-a1a2afab9c21 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.552524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 512/1018] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:23.577841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4dc2-bf2d-41b0-a618-103a5b8180e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.578453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4dc2-bf2d-41b0-a618-103a5b8180e8 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.578726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4dc2-bf2d-41b0-a618-103a5b8180e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.578995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4dc2-bf2d-41b0-a618-103a5b8180e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.579675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4dc2-bf2d-41b0-a618-103a5b8180e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.581044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4dc2-bf2d-41b0-a618-103a5b8180e8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.596978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:23.603902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 507/1019] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:42:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:42:23.822414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:23.928193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55a87-43bb-4d01-839b-3ef1296fa627 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:23.969854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438d28-5f05-41ce-a505-79de53212904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:23.970473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438d28-5f05-41ce-a505-79de53212904 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:23.970752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438d28-5f05-41ce-a505-79de53212904 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:23.971020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438d28-5f05-41ce-a505-79de53212904 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:23.971668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6438d28-5f05-41ce-a505-79de53212904 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:23.973029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6438d28-5f05-41ce-a505-79de53212904 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:23.989553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 513/1020] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:23 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:25.338943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fa32a-d0f9-418a-bba6-b009a5415376 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.339486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fa32a-d0f9-418a-bba6-b009a5415376 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.339486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fa32a-d0f9-418a-bba6-b009a5415376 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.341053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 508/1021] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:25.346378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620b91-7143-4f58-a921-c4600bc741f2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.346834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620b91-7143-4f58-a921-c4600bc741f2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.346925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620b91-7143-4f58-a921-c4600bc741f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.365623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ee620b91-7143-4f58-a921-c4600bc741f2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:25.366848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ee620b91-7143-4f58-a921-c4600bc741f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:25.381184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:25.447916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 514/1022] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:25.592199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82bcd0-f4b8-44c4-9569-ff5cf0d42141 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.592402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82bcd0-f4b8-44c4-9569-ff5cf0d42141 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.592622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82bcd0-f4b8-44c4-9569-ff5cf0d42141 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.594219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 509/1023] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:25.599195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa52456-e69a-44c7-bfcf-53bd8e282a82 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.599442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa52456-e69a-44c7-bfcf-53bd8e282a82 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.599747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa52456-e69a-44c7-bfcf-53bd8e282a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.617897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-aaa52456-e69a-44c7-bfcf-53bd8e282a82 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:25.619126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aaa52456-e69a-44c7-bfcf-53bd8e282a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:25.684711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 515/1024] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:25.717755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82bcd0-f4b8-44c4-9569-ff5cf0d42141 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:25.826678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82bcd0-f4b8-44c4-9569-ff5cf0d42141 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:25.868047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:25.868678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.868949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.869218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.870363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:25.871819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:25.873550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 510/1025] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:25.877720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0401d1-dc32-4c3b-9af1-770266a83e37 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.878252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0401d1-dc32-4c3b-9af1-770266a83e37 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.878520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0401d1-dc32-4c3b-9af1-770266a83e37 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.878935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:25.879970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 516/1026] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:25.884748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:25.885024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:25.885294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:25.903988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:25.905165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:25.950501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:25.973988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 517/1027] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:25.974819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:25.983240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:25.986856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76865d-f646-4bcd-ad60-840e1a6ad347 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.020755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.021441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.021710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.021999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.022662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.024113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.052174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 511/1028] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:42:25 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:26.086579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5fd5e-782c-422f-a14f-446330b4dbc4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.125994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.126552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.126827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.127093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.139247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:26.145122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:26.146371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:26.147192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 518/1029] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Aug 31 10:42:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:26.152822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.248512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.269566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b020e-4ea8-49a0-81c6-66049af12cd6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.297757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:26.311470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.312079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.312349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.312729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.313388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:26.313683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.315070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.321985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:26.329583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 512/1030] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:26.330699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.366931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320da1f-a9d7-4bd8-b055-e0afa23fbe62 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.401117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.401662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.401966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.402231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] PATH_INFO: `/v3/services/image` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.402799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.404169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:26.413190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:26.414219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:26.415128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 519/1031] 10.222.0.75 () {56 vars in 1105 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:26.420272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.438863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed479c-77e7-4f8e-af02-fe6f56009371 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.476311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.476958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.477234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.477737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.489290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.490768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:26.505880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:26.507067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:26.507999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:26.507999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:26.507999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:26.507999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 513/1032] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:26.514737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.527427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3c5a0-2a62-4e70-bc4c-5095994ad853 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.555129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:26.556310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:26.567424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.568042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.568313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.568579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.569198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] RBAC: Adding query filter params (name=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:26.569494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.570973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.576295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 520/1033] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:26.581964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.631867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd45e3d-d32c-4f3f-b8d9-913986513a9a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.668300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.668902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.669175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.669444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.670098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:26.670389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.671751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.684791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 514/1034] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:26.690347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.699310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688eaf4-16c1-4bb6-bec7-99c1e3fb162f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.737924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.738549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.738828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.739098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.739734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] RBAC: Adding query filter params (type=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:26.740033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.741407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.747043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 521/1035] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:26.752851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.792165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:26.795978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17248-76d9-4768-95d9-ca1d18e529af None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.815264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:26.835430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.836065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.836340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.836944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.844072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.845566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:26.857793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:26.858805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:26.859850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 515/1036] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:26.864547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.868666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74251-3da1-4384-8713-3c491d27a019 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:26.903756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:26.904389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:26.904670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:26.904937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:26.905631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] RBAC: Adding query filter params (interface=public, service_id=bda5399afc364d0eaf722863c5150ca2, region_id=RegionOne) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:26.905966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:26.907343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:26.912836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 522/1037] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/endpoints?service_id=bda5399afc364d0eaf722863c5150ca2&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:26.918676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:26.971122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d675b2d-dab3-4eb0-ae3a-fa5282665442 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:27.006195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:27.006927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:27.007305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:27.007674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:27.008399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:27.008723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:27.010175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:27.028282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1759c02-7f00-4974-8d98-270fdae0afbf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:27.033698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 516/1038] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:27.034562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:27.052832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:27.055486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:27.074350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:27.074993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:27.075271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:27.075541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:27.076139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:27.077548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:27.085293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 523/1039] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:42:26 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:42:27.143925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc775-370f-4cc9-9e9a-20e87155a8c9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:27.182067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:27.182609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:27.183216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:27.183480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:27.258289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:27.259978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:27.280975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:27.373788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 517/1040] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:42:27.375111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:27.475418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4d562-4fb3-489a-b0fd-5ee0952891f8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:27.509055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:27.509688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:27.509990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:27.510263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:27.521110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:27.522599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:27.537926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:27.538934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:27.539860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:27.539860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:27.539860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:27.539860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 524/1041] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:27.545965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:27.651193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af12683-8a2c-4d61-8b58-529834993cc4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:27.667975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:27.688076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:27.688677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:27.688943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:27.689207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:27.689942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:27.690246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:27.691596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:27.703376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 518/1042] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:27.708832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:27.745060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:27.812824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1e14-9351-4d74-909a-25831c804e05 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:27.854925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:27.855576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:27.855846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:27.856110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:27.862740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:27.864179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8cbebb26-80ba-42a8-aa42-ced3cd44e29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:27.875577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:27.876454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:27.877351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:27.878386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 525/1043] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:27.882613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:27.989634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a44dc-bbd7-43bd-8c05-50c862571980 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:28.016292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41753b49-ee91-4bef-8998-4a899b5cd7b1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.016482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41753b49-ee91-4bef-8998-4a899b5cd7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.016743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41753b49-ee91-4bef-8998-4a899b5cd7b1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.018258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 526/1044] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:28.024704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.024979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.025255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.025867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:28.026472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.026747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.027005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.027691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:28.028004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:28.029551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:28.045807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 519/1045] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:28.047017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:28.048300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:28.049030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:28.086782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:28.121927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 527/1046] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:28.155140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e3f1-5d50-44e8-9b9c-2939be3a79b8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:28.193182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:28.193794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.194232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.194477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.195204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] RBAC: Adding query filter params (role.id=6bc7457c4151474cb68e5bb34f24ab1e, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b4d48e600b4d470c88bd1606ea51c263) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:28.195501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:28.196972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:28.202767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 520/1047] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:28 2022] GET /identity/v3/role_assignments?user.id=b4d48e600b4d470c88bd1606ea51c263&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=6bc7457c4151474cb68e5bb34f24ab1e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:28.380738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:28.409483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:28.486523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9def67e-b6ff-48fc-98ab-ab94469713e2 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:28.520670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:28.521301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.521574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.521871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.532201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:28.536997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:28.538159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:28.539081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 528/1048] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:28.545828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:28.652421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:28.656808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db191e6-b247-4251-b5c7-39269296850c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:28.692070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:28.692675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.692941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.693201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.693877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:28.694169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:28.695545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:28.706095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 521/1049] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:28.709531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:28.796667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:28.813735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cabf06-7353-473d-85e8-5dac43cde4e8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:28.857700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a3fec-a274-44be-84c0-0a3eea1f013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:28.858368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a3fec-a274-44be-84c0-0a3eea1f013d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.858647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a3fec-a274-44be-84c0-0a3eea1f013d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.858920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a3fec-a274-44be-84c0-0a3eea1f013d None admin] PATH_INFO: `/v3/users/4a774122813249f48e2e9a90da29ff84` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:28.872319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a3fec-a274-44be-84c0-0a3eea1f013d None admin] RBAC: Authorizing `identity:get_user(user_id=4a774122813249f48e2e9a90da29ff84)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:28.873765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a3fec-a274-44be-84c0-0a3eea1f013d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:28.875586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 529/1050] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:28 2022] GET /identity/v3/users/4a774122813249f48e2e9a90da29ff84 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:28.881374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:28.991251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958398ec-5de0-4de1-bdde-0db08ed3a920 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:28.998807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000b7e-0806-4659-9a0d-93325ad95c39 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:28.999204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000b7e-0806-4659-9a0d-93325ad95c39 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:28.999548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000b7e-0806-4659-9a0d-93325ad95c39 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.001029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 530/1051] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:29.006231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.006482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.006760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.025179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:29.026435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:29.030973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:29.031584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.031858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.032125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.069570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:29.097605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 531/1052] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:29.104371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:29.105902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:29.206963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 522/1053] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:29.212999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:29.293590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:29.324913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca99ccd-efc4-416e-9c6b-a179e93e0e9f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:29.360449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:29.361124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.361406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.361679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.362837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] RBAC: Authorizing `identity:get_project(project_id=23c1d884187d4310b77b17f5e79254a7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:29.364279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:29.364929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:29.370926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 532/1054] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:29 2022] GET /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:29.372284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:29.429089 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:29.470821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6afa4-f028-458a-9527-a3c6db587840 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:29.477921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1a0e-9d12-45a7-958a-f30813c19a9d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:29.506542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:29.507171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.507436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.507700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] PATH_INFO: `/v3/services/image` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.508277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:29.509747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:29.514233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:29.514843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.515127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.515398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.516118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=23c1d884187d4310b77b17f5e79254a7, user.id=4a774122813249f48e2e9a90da29ff84) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:29.516424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:29.517876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:29.518712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:29.519657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:29.521173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 523/1055] 10.222.0.75 () {56 vars in 1105 bytes} [Wed Aug 31 10:42:29 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:29.533923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 533/1056] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:29 2022] GET /identity/v3/role_assignments?user.id=4a774122813249f48e2e9a90da29ff84&scope.project.id=23c1d884187d4310b77b17f5e79254a7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:29.534138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:29.647084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db645d8-4c1d-4dc3-a72c-2a2dcdb86a0b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:29.676404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:29.687042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:29.687651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.687924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.688193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.688823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] RBAC: Adding query filter params (name=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:29.689119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:29.690599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:29.700611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 524/1057] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:29.702894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:29.712412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:29.814919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70177e-7cc3-4c02-824f-666f87027591 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:29.855439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:29.856180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:29.856474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:29.856743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:29.857369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] RBAC: Adding query filter params (type=image) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:29.857665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:29.859179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714f2fa-b307-4447-871e-3c6aa7415abc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:29.864350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 534/1058] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:29.870105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:29.973048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30471-03bd-481a-b4b2-8ac8b78f1d08 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:30.007114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549e35a-c2b4-4bc8-800e-279d46b947b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:30.008070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549e35a-c2b4-4bc8-800e-279d46b947b4 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:30.008553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549e35a-c2b4-4bc8-800e-279d46b947b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:30.009348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549e35a-c2b4-4bc8-800e-279d46b947b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:30.010269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549e35a-c2b4-4bc8-800e-279d46b947b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:30.011835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549e35a-c2b4-4bc8-800e-279d46b947b4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:30.034233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 525/1059] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:42:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:30.083074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a39f-58b0-4d55-a965-cd7e88bc4114 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:30.083361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a39f-58b0-4d55-a965-cd7e88bc4114 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:30.083774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a39f-58b0-4d55-a965-cd7e88bc4114 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:30.085294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 535/1060] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:30.091312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:30.091627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:30.091863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:30.111514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:30.112763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:30.162257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:30.198770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 526/1061] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:30.468083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a39f-58b0-4d55-a965-cd7e88bc4114 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:30.544066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:30.578861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a39f-58b0-4d55-a965-cd7e88bc4114 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:30.615294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:30.615929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:30.616209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:30.616478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:30.627456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:30.632387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:30.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:30.638790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 536/1062] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Aug 31 10:42:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:30.639678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:30.740020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce31d-50e7-4b7e-8107-64e6cd6204a6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:30.773330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:30.773971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:30.774248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:30.774520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:30.775248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:30.775541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:30.776983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:30.785027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 527/1063] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:42:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:30.790695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:30.899908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3e009-3961-4d4b-8fff-1487ab4d13fc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:30.929272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:30.937358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:30.938034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:30.938320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:30.938598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:30.949476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:30.950952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:30.964961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:30.966166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:30.967067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:30.967067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:30.967067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:30.970091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 537/1064] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:30.971872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.007114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:31.076957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3e117-9b38-4cff-9457-be849c4ea900 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.112289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.112899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.113166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.113429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.114107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:31.114399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:31.115752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:31.133939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 528/1065] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:31.135746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.236258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c31c70-1815-4015-a261-b7d053f78901 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.269742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.270312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.270600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.270892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.279976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:31.281419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b16a90d4-feb2-4125-b987-9feeefe04deb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:31.292480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:31.293400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:31.299295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 538/1066] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:31.301421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.401162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:31.406969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474893b-1668-4065-bf46-851acc4d166e None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.407259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474893b-1668-4065-bf46-851acc4d166e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.407637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474893b-1668-4065-bf46-851acc4d166e None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.409120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 539/1067] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:31.409444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429f455-73ef-4444-a02b-0c26d851fb49 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.413980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.414265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.414533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.434237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:31.435532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:31.445266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.445904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.446176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.446438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.447155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:31.447470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:31.448878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:31.466979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 529/1068] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:31.473154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.477709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:31.511277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 540/1069] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:42:31.572694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe2e2-2151-401b-8729-d3397f7bca19 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.607152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.607775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.608046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.608305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.618386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:31.620007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:31.635596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:31.636584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:31.642318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:31.642318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:31.642318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:31.642318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 530/1070] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:31.644083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.752678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df38489-dcac-4346-8604-38d64ca8c852 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.773904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.778471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:31.789090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.789709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.790012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.790281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.791189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:31.791687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:31.793988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:31.818919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 541/1071] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:31.821017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.863157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:31.897926 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c970-e3ba-4171-84ee-e3ae53fd209b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.933478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.934128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.934397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.934659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.939669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327f199-caff-4af1-ab98-aa5f1089df52 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:31.946074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:31.950916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:31.951847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:31.953103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 531/1072] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:31.957907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:31.979895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:31.980540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:31.980837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:31.981109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:31.987736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:31.989222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8af91242-b571-4aaf-b1a9-78a52a573a84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:32.000571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:32.001609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:32.002676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 542/1073] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:32.003274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7bde-82f3-46ca-943a-8876891715e9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.003274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7bde-82f3-46ca-943a-8876891715e9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.003427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7bde-82f3-46ca-943a-8876891715e9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.004564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 543/1074] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:32.009221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c7bde-82f3-46ca-943a-8876891715e9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.024193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:32.063278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109d1b2-6b43-49c4-a5af-9d6c0e04d47b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.095906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.096506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.096776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.097071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.097696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:32.098020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.099441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c938ce8-9a0d-478e-b259-a6fd83270bf4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.102401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:32.108436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 532/1075] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:32.109650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.110021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.110356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.118193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c7bde-82f3-46ca-943a-8876891715e9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.127382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:32.128554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:32.153435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.154198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.154536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.154810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.155492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:32.155791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.157240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.169037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 544/1076] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:32.169853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.198460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 533/1077] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:32.199283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.262920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:32.278292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d098d7-d0a4-4a1a-bd6f-bd62ea3c6a12 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.310778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53340c12-04b2-4057-8738-4aa069194e4e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.318035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.318667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.318973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.319240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] PATH_INFO: `/v3/users/4a774122813249f48e2e9a90da29ff84` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.320347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] RBAC: Authorizing `identity:get_user(user_id=4a774122813249f48e2e9a90da29ff84)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.321840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.323454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 545/1078] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:32 2022] GET /identity/v3/users/4a774122813249f48e2e9a90da29ff84 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:32.329300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.353220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:32.355837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.357077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.357525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.358150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b4d48e600b4d470c88bd1606ea51c263/roles/6bc7457c4151474cb68e5bb34f24ab1e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.360731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=b4d48e600b4d470c88bd1606ea51c263, role_id=6bc7457c4151474cb68e5bb34f24ab1e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.363468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.381054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 534/1079] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:42:32 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/b4d48e600b4d470c88bd1606ea51c263/roles/6bc7457c4151474cb68e5bb34f24ab1e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:42:32.471349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d05c-022d-4003-b04d-8f94c078bfb5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.508333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.510972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.511629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.511908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.512179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.513357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] RBAC: Authorizing `identity:get_project(project_id=23c1d884187d4310b77b17f5e79254a7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.514848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.516661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 546/1080] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:32 2022] GET /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:32.522688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.618243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:32.620903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb690984-21d5-49ee-b7a3-dc539666ced0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.633552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bd5c8-3e76-42f5-89be-e4efd33d8819 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:32.638922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:32.662078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.662696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.663123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.663393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.672785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:32.674011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:32.674291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:32.674558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7/users/4a774122813249f48e2e9a90da29ff84/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:32.676797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] RBAC: Authorizing `identity:create_grant(project_id=23c1d884187d4310b77b17f5e79254a7, user_id=4a774122813249f48e2e9a90da29ff84, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.678389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.694521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 547/1081] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:42:32 2022] PUT /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7/users/4a774122813249f48e2e9a90da29ff84/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:42:32.741319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:32.742842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:32.859077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 535/1082] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:42:32.865534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:32.970683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5961-f0ef-48fd-b381-a704ce9bc751 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:33.005653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:33.006327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:33.006600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:33.006866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:33.017216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:33.018688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:33.027558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-e30e0baa-9b49-4298-b66f-02fe8991248e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:33.035124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:33.036081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:33.037069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:33.037069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:33.037069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:33.041424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 548/1083] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:33.042943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:33.060804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:33.142670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947253-b4f3-48d7-9eb5-95b77ae8e2c8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:33.177218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:33.177853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:33.178126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:33.178387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:33.179016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:33.179306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:33.180660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee9ed-8662-482b-8b89-2e4254be6298 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:33.192646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 536/1084] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:34.286909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82088-70f2-4615-8d86-636102e86711 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:34.287485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82088-70f2-4615-8d86-636102e86711 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:34.287485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82088-70f2-4615-8d86-636102e86711 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:34.288807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 549/1085] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:34.294288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae812-7f6e-4ec3-ac6b-e3c6de9323be None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:34.294666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae812-7f6e-4ec3-ac6b-e3c6de9323be None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:34.294827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae812-7f6e-4ec3-ac6b-e3c6de9323be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:34.314139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e23ae812-7f6e-4ec3-ac6b-e3c6de9323be None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:34.315352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e23ae812-7f6e-4ec3-ac6b-e3c6de9323be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:34.384784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 537/1086] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:34.595067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9618205-0faa-4376-bcef-7fece23b85df None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:34.595259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9618205-0faa-4376-bcef-7fece23b85df None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:34.595519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9618205-0faa-4376-bcef-7fece23b85df None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:34.596895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 550/1087] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:34.602205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:34.602562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:34.602832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:34.615990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:34.622873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:34.624062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:34.656712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9618205-0faa-4376-bcef-7fece23b85df None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:34.693629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 538/1088] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:34.762656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9618205-0faa-4376-bcef-7fece23b85df None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:34.796715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:34.797337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:34.797619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:34.797919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:34.809242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:34.814085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:34.815042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:34.815881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 551/1089] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Aug 31 10:42:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:34.821316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:34.921407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7aae-58a4-4b6a-9bb8-cd5a830c0476 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:34.954549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:34.955141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:34.955412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:34.955655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:34.956305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:34.956608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:34.956848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:34.958031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:34.960513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:34.971734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 539/1090] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:42:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:34.972532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.018630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.071336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b7650-6ac0-4f6a-9183-17e479a81f12 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.083633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a353-7e60-4115-adf1-95aa858bffb4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.105975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.106549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.106827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.107087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.116143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.116762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.117034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.117145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:35.117302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:35.122493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:35.123575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:35.124410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 552/1091] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:35.129433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.129553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.130990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:35.145115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:35.146264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:35.147120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:35.147120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:35.147120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:35.147120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 540/1092] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:35.152272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.200384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.232397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796b654-cd24-4a1d-b7d8-4bbb87536acf None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.249684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c98d-4912-4cec-9741-9b8f53677dc3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.251221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.265505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.266123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.266405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.266675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.267328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:35.267629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.268999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.278651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 553/1093] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:35.284786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.290542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.291171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.291449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.291713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.292347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:35.292637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.294014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.310965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 541/1094] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:35.311969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.382076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ab38-c1ac-4762-aee8-f432f678fc1a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.410191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21a28-4394-49ca-9fde-bb27f757068f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.417141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.418052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.418328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.418621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] PATH_INFO: `/v3/users/4a774122813249f48e2e9a90da29ff84` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.419775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] RBAC: Authorizing `identity:get_user(user_id=4a774122813249f48e2e9a90da29ff84)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.420920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.421282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.423723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 554/1095] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/users/4a774122813249f48e2e9a90da29ff84 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:35.429453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.446743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.447428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.447702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.447969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.454996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.456440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:42:35.468263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:35.469274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:42:35.470248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:35.474105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 542/1096] 10.222.0.75 () {56 vars in 1093 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:35.475185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.480056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.529626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629d8a6-33d3-497f-9027-1dfc23d5c609 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.564179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.564783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.565062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.565336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.577632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0573-a5d2-43c7-94c3-bbdb9d88fb51 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.610739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.611343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.611616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.611883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.612612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:35.612909 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.614374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.631979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 543/1097] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:35.635766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.637174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.637905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.665080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.687559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.736883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15b93-b321-466f-b5cb-946064933132 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.742666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 555/1098] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:35.743922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.770580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.771186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.771456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.771720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.837134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.838693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.842324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e701f5-cb44-4ca1-8d90-d109529532a0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:35.877026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.888421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:35.889000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:35.889323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:35.889580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:35.890780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] RBAC: Authorizing `identity:get_project(project_id=23c1d884187d4310b77b17f5e79254a7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:35.892223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:35.893899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 556/1099] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:35.899938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:35.918283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:35.949717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 544/1100] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:42:35.955547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:36.000931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ece653-e742-4b9a-9f06-23b971aa3a25 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:36.034571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:36.035533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:36.035808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:36.036060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:36.036770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=23c1d884187d4310b77b17f5e79254a7, user.id=4a774122813249f48e2e9a90da29ff84) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:36.037065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:36.038526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:36.045228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 557/1101] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/role_assignments?user.id=4a774122813249f48e2e9a90da29ff84&scope.project.id=23c1d884187d4310b77b17f5e79254a7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:36.053916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd61ac-9f20-49d5-9d9b-389a50761989 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:36.083834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:36.093418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:36.094108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:36.094380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:36.094650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:36.106322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:36.107800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:42:36.124113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:36.125171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:42:36.126099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:42:36.126099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:42:36.126099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:36.126099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 545/1102] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:36.131528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:36.219284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:36.239164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d535-203c-40e4-b08e-031e2ad93839 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:36.272866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:36.273482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:36.273761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:36.274057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:36.274688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:36.274987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:36.276533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:36.288708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 558/1103] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:36.294736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:36.398642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc0c7-9e15-4127-a65c-7b4af9201e21 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:36.434900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:36.435521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:36.435790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:36.436056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:36.442751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:36.444184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:42:36.456383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:36.457280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:42:36.458251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 546/1104] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:36.463637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:36.566042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b10b-18b0-4a02-a9b6-c69df7f87beb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:36.601805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:36.602422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:36.602663 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:36.602958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:36.603680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:36.603982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:36.605426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e6fc2-9e33-4d21-b5ad-b1c1947b6d08 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:36.617164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 559/1105] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:36.623557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:36.669104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:36.731072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453704-2a35-4efb-bafe-b5ffe7636ac1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:36.765631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:36.766261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:36.766534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:36.766802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:36.767519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] RBAC: Adding query filter params (role.id=6bc7457c4151474cb68e5bb34f24ab1e, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=b4d48e600b4d470c88bd1606ea51c263) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:36.767822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:36.769237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6781bf-5697-454b-b383-8495c3be78c6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:36.775119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 547/1106] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:36 2022] GET /identity/v3/role_assignments?user.id=b4d48e600b4d470c88bd1606ea51c263&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=6bc7457c4151474cb68e5bb34f24ab1e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:37.958280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173611-2372-4a84-8304-ebe79c6b11f2 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:37.958853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173611-2372-4a84-8304-ebe79c6b11f2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:37.958853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173611-2372-4a84-8304-ebe79c6b11f2 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:37.960166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 560/1107] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:37.966664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:37.967396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:37.967582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:37.990618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:37.991808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:38.075206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 548/1108] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:38.341348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1173611-2372-4a84-8304-ebe79c6b11f2 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:38.346114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:38.459481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1173611-2372-4a84-8304-ebe79c6b11f2 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:38.494165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa38da8-1b1c-4767-badd-042d986f42af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:38.494791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38da8-1b1c-4767-badd-042d986f42af None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:38.495063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38da8-1b1c-4767-badd-042d986f42af None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:38.495326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38da8-1b1c-4767-badd-042d986f42af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:38.496530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa38da8-1b1c-4767-badd-042d986f42af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:38.498001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa38da8-1b1c-4767-badd-042d986f42af None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:38.499570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 561/1109] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:38.506511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:38.547151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:38.631349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a9b04-a03f-4bd9-b7e1-673a9e148535 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:38.665991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb36292-dd51-4512-a12c-eeb8966b9468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:38.666654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb36292-dd51-4512-a12c-eeb8966b9468 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:38.666930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb36292-dd51-4512-a12c-eeb8966b9468 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:38.667196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb36292-dd51-4512-a12c-eeb8966b9468 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:38.667842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb36292-dd51-4512-a12c-eeb8966b9468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:38.669307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb36292-dd51-4512-a12c-eeb8966b9468 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:38.698013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 549/1110] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:42:38 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:40.634234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2936ca-6239-43ef-8768-570e5d89d210 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:40.635103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2936ca-6239-43ef-8768-570e5d89d210 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:40.635226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2936ca-6239-43ef-8768-570e5d89d210 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:40.636693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 562/1111] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:40.642207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:40.642620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:40.642726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:40.663246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:40.664432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:40.735174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 550/1112] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:41.010560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2936ca-6239-43ef-8768-570e5d89d210 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:41.094587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:41.129899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2936ca-6239-43ef-8768-570e5d89d210 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:41.164479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:41.165089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:41.165360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:41.165620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] PATH_INFO: `/v3/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:41.167256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] RBAC: Authorizing `identity:get_role(role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:41.168622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:41.169964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 563/1113] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:41 2022] GET /identity/v3/roles/82cfaa1d7baa4067892940a470beb46e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:41.176934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:41.201345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:41.295973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cfc6a-ba00-4283-9fb4-644fc312e2ea None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:41.336543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:41.337190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:41.337459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:41.337722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] PATH_INFO: `/v3/users/57be32e96e0d4bd8a22472a33cbc1720` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:41.351663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] RBAC: Authorizing `identity:get_user(user_id=57be32e96e0d4bd8a22472a33cbc1720)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:41.353128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:41.354824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 551/1114] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:41 2022] GET /identity/v3/users/57be32e96e0d4bd8a22472a33cbc1720 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:41.364570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:41.469293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdbd2-cee8-43f2-bce9-b00a7660ab13 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:41.504647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:41.505260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:41.505540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:41.505832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:41.514795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:41.573695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:41.575117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:41.673161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 564/1115] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:41.680053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:41.765719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:41.791489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81acee-90bd-4c2a-a430-996c89481478 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:41.845444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7047f-80e2-49d4-ad57-39b528c7bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:41.846063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7047f-80e2-49d4-ad57-39b528c7bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:41.846342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7047f-80e2-49d4-ad57-39b528c7bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:41.847042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7047f-80e2-49d4-ad57-39b528c7bcd9 None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:41.847978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7047f-80e2-49d4-ad57-39b528c7bcd9 None admin] RBAC: Authorizing `identity:get_project(project_id=23c1d884187d4310b77b17f5e79254a7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:41.849449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7047f-80e2-49d4-ad57-39b528c7bcd9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:41.851226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 552/1116] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:41 2022] GET /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:41.857918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:41.905172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:41.971143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a02735-b032-4c09-b844-c0cd8b565887 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:42.006360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:42.006976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:42.007248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:42.007515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:42.008232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] RBAC: Adding query filter params (role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=23c1d884187d4310b77b17f5e79254a7, user.id=57be32e96e0d4bd8a22472a33cbc1720) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:42.008528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:42.010016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f25e4-a70c-49de-ae7f-b3de5046fca1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:42.015504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 565/1117] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:41 2022] GET /identity/v3/role_assignments?user.id=57be32e96e0d4bd8a22472a33cbc1720&scope.project.id=23c1d884187d4310b77b17f5e79254a7&role.id=82cfaa1d7baa4067892940a470beb46e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:43.888986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98ac9-65f4-4cb5-9870-8a24199a35f5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:43.889861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98ac9-65f4-4cb5-9870-8a24199a35f5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:43.889861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98ac9-65f4-4cb5-9870-8a24199a35f5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:43.892118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 553/1118] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:43.897386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:43.897839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:43.897969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:43.918477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:43.920110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:43.993441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 566/1119] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:44.257904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98ac9-65f4-4cb5-9870-8a24199a35f5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:44.376163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98ac9-65f4-4cb5-9870-8a24199a35f5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:44.412006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:44.412619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:44.412884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:44.413143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] PATH_INFO: `/v3/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:44.414650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] RBAC: Authorizing `identity:get_role(role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:44.416032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:44.417407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 554/1120] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:44 2022] GET /identity/v3/roles/82cfaa1d7baa4067892940a470beb46e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:44.426292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:44.460042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:44.531922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eabf3f-7c41-476d-8e2b-31d8ec6fad49 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:44.567332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:44.567951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:44.568228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:44.568499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] PATH_INFO: `/v3/users/57be32e96e0d4bd8a22472a33cbc1720` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:44.569740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] RBAC: Authorizing `identity:get_user(user_id=57be32e96e0d4bd8a22472a33cbc1720)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:44.571224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:44.572853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 567/1121] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:44 2022] GET /identity/v3/users/57be32e96e0d4bd8a22472a33cbc1720 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:44.578913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:44.595592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:44.679105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6f55-3f50-44a7-93a3-161b5076cc12 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:44.719848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edea58-e8af-40f1-9c66-d4c1142b5361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:44.720464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edea58-e8af-40f1-9c66-d4c1142b5361 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:44.720731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edea58-e8af-40f1-9c66-d4c1142b5361 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:44.720993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edea58-e8af-40f1-9c66-d4c1142b5361 None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:44.722231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edea58-e8af-40f1-9c66-d4c1142b5361 None admin] RBAC: Authorizing `identity:get_project(project_id=23c1d884187d4310b77b17f5e79254a7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:44.723659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edea58-e8af-40f1-9c66-d4c1142b5361 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:44.725297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 555/1122] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:44 2022] GET /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:44.735282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:44.847983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:44.851167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fc6c7-c8a1-478b-9cba-e4762b0e4eff None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:44.891123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3dc83-e0ea-41de-90db-0708d1b6f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:44.891802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3dc83-e0ea-41de-90db-0708d1b6f69a None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:44.892078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3dc83-e0ea-41de-90db-0708d1b6f69a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:44.892343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3dc83-e0ea-41de-90db-0708d1b6f69a None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7/users/57be32e96e0d4bd8a22472a33cbc1720/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:44.894935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3dc83-e0ea-41de-90db-0708d1b6f69a None admin] RBAC: Authorizing `identity:create_grant(project_id=23c1d884187d4310b77b17f5e79254a7, user_id=57be32e96e0d4bd8a22472a33cbc1720, role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:44.896500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3dc83-e0ea-41de-90db-0708d1b6f69a None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:44.912669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 568/1123] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:42:44 2022] PUT /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7/users/57be32e96e0d4bd8a22472a33cbc1720/roles/82cfaa1d7baa4067892940a470beb46e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:42:46.777136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038170e-bfb8-40c2-bfe1-07a69b0868e0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:46.777733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038170e-bfb8-40c2-bfe1-07a69b0868e0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:46.777733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038170e-bfb8-40c2-bfe1-07a69b0868e0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:46.779075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 556/1124] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:46.785546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:46.786316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:46.786487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:46.808749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:46.810331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:46.886628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 569/1125] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:47.171445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038170e-bfb8-40c2-bfe1-07a69b0868e0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:47.265007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:47.285503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038170e-bfb8-40c2-bfe1-07a69b0868e0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:47.320674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:47.321288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:47.321558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:47.321825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] PATH_INFO: `/v3/roles/82cfaa1d7baa4067892940a470beb46e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:47.323305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] RBAC: Authorizing `identity:get_role(role_id=82cfaa1d7baa4067892940a470beb46e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:47.324671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:47.326026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 557/1126] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:47 2022] GET /identity/v3/roles/82cfaa1d7baa4067892940a470beb46e => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:47.332297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:47.429801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:47.446618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b751ee-79e9-4aeb-b9de-f07d228b991f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:47.490394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:47.491309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:47.491709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:47.492095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] PATH_INFO: `/v3/users/57be32e96e0d4bd8a22472a33cbc1720` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:47.494060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] RBAC: Authorizing `identity:get_user(user_id=57be32e96e0d4bd8a22472a33cbc1720)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:47.496376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:47.498953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 570/1127] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:47 2022] GET /identity/v3/users/57be32e96e0d4bd8a22472a33cbc1720 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:47.512215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:47.614975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2a08-e214-43cb-95ba-403ce7bcb15d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:47.649370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:47.649984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:47.650262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:47.650531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:47.668839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:47.728523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:47.730211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:47.834991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 558/1128] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:47.841369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:47.944094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7962c9-4cbf-4b05-946b-22ef53f56841 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:47.983408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd3636-de0e-46cc-a1b0-755ff888fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:47.983943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd3636-de0e-46cc-a1b0-755ff888fec9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:47.984567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd3636-de0e-46cc-a1b0-755ff888fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:47.984839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd3636-de0e-46cc-a1b0-755ff888fec9 None admin] PATH_INFO: `/v3/projects/23c1d884187d4310b77b17f5e79254a7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:47.986043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd3636-de0e-46cc-a1b0-755ff888fec9 None admin] RBAC: Authorizing `identity:get_project(project_id=23c1d884187d4310b77b17f5e79254a7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:47.987496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd3636-de0e-46cc-a1b0-755ff888fec9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:47.989165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 571/1129] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:47 2022] GET /identity/v3/projects/23c1d884187d4310b77b17f5e79254a7 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:47.996650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:48.061460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:48.114774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9ffc-8c16-4d76-9689-ff8520c89ca7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:48.156124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:48.156723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:48.156996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:48.157260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:48.158017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] RBAC: Adding query filter params (role.id=82cfaa1d7baa4067892940a470beb46e, scope.project.id=23c1d884187d4310b77b17f5e79254a7, user.id=57be32e96e0d4bd8a22472a33cbc1720) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:48.158319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:48.159741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db247055-a109-4ce1-9292-ea9015c8fb13 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:48.166079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 559/1130] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:47 2022] GET /identity/v3/role_assignments?user.id=57be32e96e0d4bd8a22472a33cbc1720&scope.project.id=23c1d884187d4310b77b17f5e79254a7&role.id=82cfaa1d7baa4067892940a470beb46e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:50.065511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2705-7b37-4fec-b3e2-699e0e03e22d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:50.066396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2705-7b37-4fec-b3e2-699e0e03e22d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:50.066396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2705-7b37-4fec-b3e2-699e0e03e22d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:50.068538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 572/1131] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:50.074739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:50.075464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:50.075611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:50.099990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:50.101131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:50.172365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 560/1132] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:50.438682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2705-7b37-4fec-b3e2-699e0e03e22d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:50.472507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:50.559216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2705-7b37-4fec-b3e2-699e0e03e22d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:50.593998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b302c2-ea83-40db-8ebd-8ece9e4bece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:50.594623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b302c2-ea83-40db-8ebd-8ece9e4bece7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:50.594900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b302c2-ea83-40db-8ebd-8ece9e4bece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:50.595160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b302c2-ea83-40db-8ebd-8ece9e4bece7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:50.596299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b302c2-ea83-40db-8ebd-8ece9e4bece7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:50.597743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b302c2-ea83-40db-8ebd-8ece9e4bece7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:50.599340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 573/1133] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:50.607613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:50.655069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:50.715166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e748eb-ba73-4c5d-af84-7d59d6140f6f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:50.752737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bb59-6c06-4db7-bbec-582985565ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:50.753589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bb59-6c06-4db7-bbec-582985565ee3 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:50.753965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bb59-6c06-4db7-bbec-582985565ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:50.754353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bb59-6c06-4db7-bbec-582985565ee3 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:50.755338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63bb59-6c06-4db7-bbec-582985565ee3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:50.757576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63bb59-6c06-4db7-bbec-582985565ee3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:50.793727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 561/1134] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:42:50 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:52.696277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99b30b-5a9a-427a-b9c8-e41e704c2bac None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:52.696860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99b30b-5a9a-427a-b9c8-e41e704c2bac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:52.696860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99b30b-5a9a-427a-b9c8-e41e704c2bac None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:52.698394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 574/1135] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:52.704716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:52.705440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:52.705574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:52.734037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:52.735225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:52.803647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 562/1136] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:53.077118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99b30b-5a9a-427a-b9c8-e41e704c2bac None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:53.178886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:53.187156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99b30b-5a9a-427a-b9c8-e41e704c2bac None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:53.221086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f82c-5e3d-485d-ba32-a7ddc16648d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:53.221674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f82c-5e3d-485d-ba32-a7ddc16648d5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:53.221979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f82c-5e3d-485d-ba32-a7ddc16648d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:53.222243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f82c-5e3d-485d-ba32-a7ddc16648d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:53.223342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f82c-5e3d-485d-ba32-a7ddc16648d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:53.224753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f82c-5e3d-485d-ba32-a7ddc16648d5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:53.226361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 575/1137] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:53.235642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:53.273740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:53.357602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebf998-5fcb-43d8-9d27-fa30742be768 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:53.393857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3bfb4-dbce-4e0e-89f4-f4429f9e7f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:53.394448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3bfb4-dbce-4e0e-89f4-f4429f9e7f65 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:53.394718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3bfb4-dbce-4e0e-89f4-f4429f9e7f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:53.394979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3bfb4-dbce-4e0e-89f4-f4429f9e7f65 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:53.395641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3bfb4-dbce-4e0e-89f4-f4429f9e7f65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:53.397095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3bfb4-dbce-4e0e-89f4-f4429f9e7f65 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:53.421129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 563/1138] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:42:53 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:42:55.332035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d33b-dfc6-456a-bf4d-cba2e88e6c5b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:55.332633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d33b-dfc6-456a-bf4d-cba2e88e6c5b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:55.332633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d33b-dfc6-456a-bf4d-cba2e88e6c5b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:55.333954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 576/1139] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:55.340393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:55.341099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:55.341250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:55.372006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:55.373203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:55.444170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 564/1140] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:55.715132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d33b-dfc6-456a-bf4d-cba2e88e6c5b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:55.830476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d33b-dfc6-456a-bf4d-cba2e88e6c5b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:55.873577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:55.874241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:55.874513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:55.874786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:55.884954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:55.889877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:55.891111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:55.892203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 577/1141] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:55.897315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:55.912087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:56.005177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697098d-027b-41ac-b365-a89317a3eb94 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:56.043664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:56.044268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:56.044540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:56.044804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:56.045474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:56.045806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:56.047173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:56.055445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 565/1142] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:56.064170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:56.102721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:56.193706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c522694-bf5a-4544-bd7e-b95b18b9443a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:56.229489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:56.230171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:56.230446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:56.230714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] PATH_INFO: `/v3/users/68ee320e95bd489289f1d43599c9c87f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:56.244354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] RBAC: Authorizing `identity:get_user(user_id=68ee320e95bd489289f1d43599c9c87f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:56.245919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:56.247558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 578/1143] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:56 2022] GET /identity/v3/users/68ee320e95bd489289f1d43599c9c87f => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:56.257228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:56.336091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:56.366604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ccbe-a55f-435d-b2bf-78390c1e5381 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:56.402956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:56.403563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:56.403836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:56.404104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:56.481524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:56.483005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:56.557531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:56.593715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 566/1144] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:42:56.600068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:56.686330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:56.706055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a13e5-a148-41b7-84d4-660797361cac None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:56.742223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7382-fa9c-49b7-9d73-9e9b747b7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:56.742837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7382-fa9c-49b7-9d73-9e9b747b7f33 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:56.743110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7382-fa9c-49b7-9d73-9e9b747b7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:56.743380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7382-fa9c-49b7-9d73-9e9b747b7f33 None admin] PATH_INFO: `/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:56.744536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee7382-fa9c-49b7-9d73-9e9b747b7f33 None admin] RBAC: Authorizing `identity:get_project(project_id=5b2fa823f983470c9bf39f5ba28ffc83)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:56.746049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee7382-fa9c-49b7-9d73-9e9b747b7f33 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:56.747742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 579/1145] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:56 2022] GET /identity/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:56.754913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:56.866292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6082e3-6435-415a-801b-27fbd9cc2aac None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:56.901323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:56.902240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:56.902240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:56.902519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:56.903318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=5b2fa823f983470c9bf39f5ba28ffc83, user.id=68ee320e95bd489289f1d43599c9c87f) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:56.903536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:56.904983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030af0-4e52-409f-be35-948eb5ea2e6b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:56.910287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 567/1146] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:56 2022] GET /identity/v3/role_assignments?user.id=68ee320e95bd489289f1d43599c9c87f&scope.project.id=5b2fa823f983470c9bf39f5ba28ffc83&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:58.779147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3d78f-d277-4cd1-bb1c-fcc686583f77 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:58.780012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3d78f-d277-4cd1-bb1c-fcc686583f77 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:58.780012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3d78f-d277-4cd1-bb1c-fcc686583f77 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:58.782241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 580/1147] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:42:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:58.788449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:58.789151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:58.789294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:58.811163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:58.812356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:58.845287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:58.893178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 568/1148] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:59.165817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3d78f-d277-4cd1-bb1c-fcc686583f77 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:59.278830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3d78f-d277-4cd1-bb1c-fcc686583f77 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:59.313369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:59.314016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.314290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.314556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.324930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:59.329748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:59.330796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:42:59.331647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 581/1149] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:42:59.340311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:59.454960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb2ca-9c7e-4dec-b293-aee574063fab None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:59.495258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:59.496105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.496457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.496799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.497845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:59.498242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:59.500361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:59.512847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 569/1150] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:59.519324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:59.531275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:59.639776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270d01-4a9b-464f-9bb8-01e95ceb5663 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:59.678981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:59.679620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.679894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.680168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] PATH_INFO: `/v3/users/68ee320e95bd489289f1d43599c9c87f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.681416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] RBAC: Authorizing `identity:get_user(user_id=68ee320e95bd489289f1d43599c9c87f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:59.682925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:59.684584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 582/1151] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:59 2022] GET /identity/v3/users/68ee320e95bd489289f1d43599c9c87f => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:59.694337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:59.728744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:59.801072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1ed7b-8324-4c17-bcc9-efdb18bde6ce None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:59.837437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f185a-2a0c-470d-ae22-908d3d291a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:59.838096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f185a-2a0c-470d-ae22-908d3d291a22 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.838373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f185a-2a0c-470d-ae22-908d3d291a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.838645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f185a-2a0c-470d-ae22-908d3d291a22 None admin] PATH_INFO: `/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.839938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f185a-2a0c-470d-ae22-908d3d291a22 None admin] RBAC: Authorizing `identity:get_project(project_id=5b2fa823f983470c9bf39f5ba28ffc83)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:59.841376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f185a-2a0c-470d-ae22-908d3d291a22 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:59.843056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 570/1152] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:59 2022] GET /identity/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:42:59.849849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:59.934620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:59.959734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012905-e908-4e19-a1dd-54677b2a7787 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:59.999211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1c52e-cc65-428b-baa9-934bdbeef1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:59.999808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1c52e-cc65-428b-baa9-934bdbeef1bf None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:00.000087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1c52e-cc65-428b-baa9-934bdbeef1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:00.000364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1c52e-cc65-428b-baa9-934bdbeef1bf None admin] PATH_INFO: `/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83/users/68ee320e95bd489289f1d43599c9c87f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:00.002541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1c52e-cc65-428b-baa9-934bdbeef1bf None admin] RBAC: Authorizing `identity:create_grant(project_id=5b2fa823f983470c9bf39f5ba28ffc83, user_id=68ee320e95bd489289f1d43599c9c87f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:00.004019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1c52e-cc65-428b-baa9-934bdbeef1bf None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:00.019243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 583/1153] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:42:59 2022] PUT /identity/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83/users/68ee320e95bd489289f1d43599c9c87f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:01.891273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f1a8-b158-4292-ba89-ac70d4297f30 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:01.891808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f1a8-b158-4292-ba89-ac70d4297f30 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:01.891808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f1a8-b158-4292-ba89-ac70d4297f30 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:01.893143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 571/1154] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:01.899650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:01.900416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:01.900556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:01.925863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:01.927034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:02.010095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 584/1155] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:02.281204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f1a8-b158-4292-ba89-ac70d4297f30 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:02.385471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:02.391302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f1a8-b158-4292-ba89-ac70d4297f30 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:02.428674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:02.429285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:02.429557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:02.429840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:02.441448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:02.446290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:02.447463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:02.448743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 572/1156] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:02.453970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:02.522985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:02.561613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8250-fa04-48a3-a9dd-38bb1ed5d3b6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:02.598197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:02.598792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:02.599071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:02.599344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:02.600000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:02.600303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:02.601679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:02.610300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 585/1157] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:02.616409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:02.728162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540f5a-ed2b-4794-afb4-eb98d0b742dc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:02.760849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:02.761492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:02.761801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:02.762068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] PATH_INFO: `/v3/users/68ee320e95bd489289f1d43599c9c87f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:02.763182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] RBAC: Authorizing `identity:get_user(user_id=68ee320e95bd489289f1d43599c9c87f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:02.764628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:02.766272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 573/1158] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:43:02 2022] GET /identity/v3/users/68ee320e95bd489289f1d43599c9c87f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:02.772525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:02.879106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8dd2a-956a-48fa-b77a-a102d037298f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:02.906847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:02.919642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:02.920511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:02.920882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:02.921254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:02.995666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:02.997214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.098987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 586/1159] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:43:03.108696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.148576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:03.225133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657508db-e9c4-43e1-8ae2-c52fcf4db268 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.260007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87771f5-484d-4d33-a1bd-58aa299912b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.260631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87771f5-484d-4d33-a1bd-58aa299912b3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.260900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87771f5-484d-4d33-a1bd-58aa299912b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.261169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87771f5-484d-4d33-a1bd-58aa299912b3 None admin] PATH_INFO: `/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.262466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87771f5-484d-4d33-a1bd-58aa299912b3 None admin] RBAC: Authorizing `identity:get_project(project_id=5b2fa823f983470c9bf39f5ba28ffc83)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:03.263889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87771f5-484d-4d33-a1bd-58aa299912b3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.265506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 574/1160] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/projects/5b2fa823f983470c9bf39f5ba28ffc83 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:03.272185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.303095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:03.390185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b5bb-b154-458b-a2c5-5aee0e432e73 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.426025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.426613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.426889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.427158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.427873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=5b2fa823f983470c9bf39f5ba28ffc83, user.id=68ee320e95bd489289f1d43599c9c87f) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:03.428174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:03.429603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3ad0-e4ce-4baf-adb7-b882288203fd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.436146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 587/1161] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/role_assignments?user.id=68ee320e95bd489289f1d43599c9c87f&scope.project.id=5b2fa823f983470c9bf39f5ba28ffc83&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:05.345648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed04b6-2ceb-41e0-a234-1667b7738098 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:05.346634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed04b6-2ceb-41e0-a234-1667b7738098 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:05.346634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed04b6-2ceb-41e0-a234-1667b7738098 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:05.348798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 575/1162] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:05.354389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:05.354836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:05.354937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:05.373229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:05.374427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:05.447756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 588/1163] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:05.712213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed04b6-2ceb-41e0-a234-1667b7738098 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:05.827835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:05.838300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed04b6-2ceb-41e0-a234-1667b7738098 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:05.874551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:05.875163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:05.875435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:05.875700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:05.942980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:05.944429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:06.035569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:06.045508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 576/1164] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:06.055029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:06.082522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:06.162702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9a48-9327-41d7-b43e-2cd235f26483 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:06.200513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:06.201231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:06.201503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:06.201764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:06.208382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:06.209854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-09dbb2e2-a96d-43ab-9a54-12e06b1a2725 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:06.221422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:06.222671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:43:06.223922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 589/1165] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:43:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:06.228984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:06.331768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151910-c82a-4a39-9d57-c853caa12bbd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:06.366616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:06.367224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:06.367453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:06.367718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:06.368341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:06.368632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:06.370012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67584dd-df04-4fd4-a74f-a3143f5d63aa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:06.377075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 577/1166] 10.222.0.75 () {56 vars in 1115 bytes} [Wed Aug 31 10:43:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:43:08.275028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364fd8-3dcb-47b4-a8c9-c5bb928e0f51 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.275925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364fd8-3dcb-47b4-a8c9-c5bb928e0f51 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.275925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364fd8-3dcb-47b4-a8c9-c5bb928e0f51 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.278342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 590/1167] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:08.283832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41385e1-1718-40db-a424-f5d1f22f204e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.284263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41385e1-1718-40db-a424-f5d1f22f204e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.284361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41385e1-1718-40db-a424-f5d1f22f204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.305332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f41385e1-1718-40db-a424-f5d1f22f204e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:08.306592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f41385e1-1718-40db-a424-f5d1f22f204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:08.367026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:08.382350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 578/1168] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:08.650890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364fd8-3dcb-47b4-a8c9-c5bb928e0f51 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:08.743708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:08.764044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364fd8-3dcb-47b4-a8c9-c5bb928e0f51 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.799183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f102-c9f1-41e3-b542-06cc740adc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.799775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f102-c9f1-41e3-b542-06cc740adc28 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.800048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f102-c9f1-41e3-b542-06cc740adc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.800317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f102-c9f1-41e3-b542-06cc740adc28 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.800967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34f102-c9f1-41e3-b542-06cc740adc28 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:08.802379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34f102-c9f1-41e3-b542-06cc740adc28 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:08.821520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 591/1169] 10.222.0.75 () {60 vars in 1138 bytes} [Wed Aug 31 10:43:08 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:10.747537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab963f7-fcaa-4da4-a2a7-a2915c5a8807 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:10.748426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab963f7-fcaa-4da4-a2a7-a2915c5a8807 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:10.748426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab963f7-fcaa-4da4-a2a7-a2915c5a8807 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:10.750664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 579/1170] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:10.756927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:10.757635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:10.757837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:10.778962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:10.780153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:10.855281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 592/1171] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:11.128068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab963f7-fcaa-4da4-a2a7-a2915c5a8807 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:11.253724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab963f7-fcaa-4da4-a2a7-a2915c5a8807 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:11.301373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbc9e5-721f-42fc-a699-ddea4116b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:11.302407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc9e5-721f-42fc-a699-ddea4116b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:11.302854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc9e5-721f-42fc-a699-ddea4116b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:11.303244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc9e5-721f-42fc-a699-ddea4116b8a7 None admin] PATH_INFO: `/v3/domains/8e75e578e8bc4670b591e3926be199d0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:11.316487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbc9e5-721f-42fc-a699-ddea4116b8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e75e578e8bc4670b591e3926be199d0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:11.317989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbc9e5-721f-42fc-a699-ddea4116b8a7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:11.319640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 580/1172] 10.222.0.75 () {56 vars in 1183 bytes} [Wed Aug 31 10:43:11 2022] GET /identity/v3/domains/8e75e578e8bc4670b591e3926be199d0 => generated 267 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:11.328693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:11.402375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:11.440166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c000b-9dc0-419a-995a-7d73e239b3ba None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:11.475741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bff12-edc2-4e56-97f1-4220c62c2b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:11.476319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bff12-edc2-4e56-97f1-4220c62c2b54 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:11.476598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bff12-edc2-4e56-97f1-4220c62c2b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:11.476865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bff12-edc2-4e56-97f1-4220c62c2b54 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:11.477519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bff12-edc2-4e56-97f1-4220c62c2b54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:11.478996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bff12-edc2-4e56-97f1-4220c62c2b54 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:11.508482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 593/1173] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:43:11 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:13.439031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a2476-6d27-42aa-923f-0c4e80f70447 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.439904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a2476-6d27-42aa-923f-0c4e80f70447 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.439904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a2476-6d27-42aa-923f-0c4e80f70447 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.442152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 581/1174] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:13.448481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.449203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.449327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.469531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:13.470772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:13.549759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 594/1175] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:13.819060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a2476-6d27-42aa-923f-0c4e80f70447 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:13.877389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:13.931495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a2476-6d27-42aa-923f-0c4e80f70447 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:13.966518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eb0a7-82fc-4654-8599-bdb7484eac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:13.967139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb0a7-82fc-4654-8599-bdb7484eac8c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.967410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb0a7-82fc-4654-8599-bdb7484eac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.967677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eb0a7-82fc-4654-8599-bdb7484eac8c None admin] PATH_INFO: `/v3/domains/8e75e578e8bc4670b591e3926be199d0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.968851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb0a7-82fc-4654-8599-bdb7484eac8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e75e578e8bc4670b591e3926be199d0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:13.970316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eb0a7-82fc-4654-8599-bdb7484eac8c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:13.971931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 582/1176] 10.222.0.75 () {56 vars in 1183 bytes} [Wed Aug 31 10:43:13 2022] GET /identity/v3/domains/8e75e578e8bc4670b591e3926be199d0 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:13.980535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:14.038679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:14.085815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455be94d-fa28-4210-b8fa-e4fa9925e67b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:14.121652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c7938-5a89-4bee-b40a-b8b79a84b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:14.122356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c7938-5a89-4bee-b40a-b8b79a84b145 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:14.122631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c7938-5a89-4bee-b40a-b8b79a84b145 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:14.122898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c7938-5a89-4bee-b40a-b8b79a84b145 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:14.123545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c7938-5a89-4bee-b40a-b8b79a84b145 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:14.125022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c7938-5a89-4bee-b40a-b8b79a84b145 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:14.152126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 595/1177] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:43:13 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:16.077272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635159-2f3e-4fad-a6cf-bb8e1afa5fa5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.078242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635159-2f3e-4fad-a6cf-bb8e1afa5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.078242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635159-2f3e-4fad-a6cf-bb8e1afa5fa5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.080379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 583/1178] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:16.085744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.086193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.086290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.106384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:16.107575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:16.178829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 596/1179] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:16.459409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635159-2f3e-4fad-a6cf-bb8e1afa5fa5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:16.577008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635159-2f3e-4fad-a6cf-bb8e1afa5fa5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:16.593188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:16.612103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:16.612726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.613003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.613273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.624132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:16.628983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:16.630081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:16.630927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 584/1180] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:16.636379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:16.679876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:16.742711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8f193-cbc7-4419-b2ff-01dd07b08f72 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:16.778670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:16.779353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.779625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.779901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.780556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:16.780859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:16.782281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:16.791275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 597/1181] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:16.797475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:16.905172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea7c0-0f03-43ac-938b-bcb82fb2910c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:16.940736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:16.941366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.941641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.941935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] PATH_INFO: `/v3/users/91db778b294849caab5e0e4ec971f8c7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.955712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] RBAC: Authorizing `identity:get_user(user_id=91db778b294849caab5e0e4ec971f8c7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:16.957197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:16.958875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 585/1182] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:43:16 2022] GET /identity/v3/users/91db778b294849caab5e0e4ec971f8c7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:16.965292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:17.082729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe6634-7288-418b-9f32-d92bf52f09c2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:17.084356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.117962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:17.118614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:17.118838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:17.119108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:17.186520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:17.188338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:17.289079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 598/1183] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:17.296161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:17.341285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.412612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0930-a573-432a-8e6c-630f0ba12f43 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:17.447946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b949b4-18f6-4d8e-ab6d-e034a79a355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:17.448562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b949b4-18f6-4d8e-ab6d-e034a79a355a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:17.448810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b949b4-18f6-4d8e-ab6d-e034a79a355a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:17.449072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b949b4-18f6-4d8e-ab6d-e034a79a355a None admin] PATH_INFO: `/v3/projects/b32fbe49b89845168fe881e3c1e56fc3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:17.450215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b949b4-18f6-4d8e-ab6d-e034a79a355a None admin] RBAC: Authorizing `identity:get_project(project_id=b32fbe49b89845168fe881e3c1e56fc3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:17.451670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b949b4-18f6-4d8e-ab6d-e034a79a355a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:17.453285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 586/1184] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:43:17 2022] GET /identity/v3/projects/b32fbe49b89845168fe881e3c1e56fc3 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:17.459857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:17.462235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.566829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994d74d-3e03-4a9f-b8e9-0037d92fafb4 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:17.602017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:17.602546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:17.602823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:17.603093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:17.603818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=b32fbe49b89845168fe881e3c1e56fc3, user.id=91db778b294849caab5e0e4ec971f8c7) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:17.604123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:17.605544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2da898-ef25-40f5-87c5-666cdbcdf5f2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:17.611222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 599/1185] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:17 2022] GET /identity/v3/role_assignments?user.id=91db778b294849caab5e0e4ec971f8c7&scope.project.id=b32fbe49b89845168fe881e3c1e56fc3&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:19.477367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542ad55-b98b-4abe-8ac7-36562a1fd7a1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.478308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542ad55-b98b-4abe-8ac7-36562a1fd7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.478308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542ad55-b98b-4abe-8ac7-36562a1fd7a1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.480371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 587/1186] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:19.486183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.486612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.486798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.514935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:19.516120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:19.581135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:19.589940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 600/1187] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:19.856498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542ad55-b98b-4abe-8ac7-36562a1fd7a1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:19.978820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542ad55-b98b-4abe-8ac7-36562a1fd7a1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:19.980422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:20.015513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:20.016136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:20.016413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:20.016682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:20.026691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:20.031582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:20.032608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:20.033803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 588/1188] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:20.040781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:20.148604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6c3bf-ccff-44ee-b74f-e962aa99fc55 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:20.189041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:20.189658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:20.189964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:20.190236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:20.190895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:20.191192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:20.192574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:20.200891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 601/1189] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:20.210213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:20.329109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a133db-628d-45d7-8d42-aa873171220c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:20.367740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:20.368369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:20.368661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:20.368927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] PATH_INFO: `/v3/users/91db778b294849caab5e0e4ec971f8c7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:20.370197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] RBAC: Authorizing `identity:get_user(user_id=91db778b294849caab5e0e4ec971f8c7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:20.371647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:20.373361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 589/1190] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:43:20 2022] GET /identity/v3/users/91db778b294849caab5e0e4ec971f8c7 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:20.383642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:20.445431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:20.498083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19ca8-82c8-420b-8e63-081ae18d66d5 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:20.533077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69a108-65b2-43a6-b572-0651563594d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:20.533708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69a108-65b2-43a6-b572-0651563594d7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:20.534022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69a108-65b2-43a6-b572-0651563594d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:20.534290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69a108-65b2-43a6-b572-0651563594d7 None admin] PATH_INFO: `/v3/projects/b32fbe49b89845168fe881e3c1e56fc3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:20.535534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69a108-65b2-43a6-b572-0651563594d7 None admin] RBAC: Authorizing `identity:get_project(project_id=b32fbe49b89845168fe881e3c1e56fc3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:20.536985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69a108-65b2-43a6-b572-0651563594d7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:20.538972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 602/1191] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:43:20 2022] GET /identity/v3/projects/b32fbe49b89845168fe881e3c1e56fc3 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:20.545621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:20.578496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:20.651532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40656-4e28-4976-a0ac-0750b907dbd7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:20.691016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f9e91-ca56-4337-aa23-a99d996152b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:20.691659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9e91-ca56-4337-aa23-a99d996152b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:20.691932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9e91-ca56-4337-aa23-a99d996152b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:20.692193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9e91-ca56-4337-aa23-a99d996152b3 None admin] PATH_INFO: `/v3/projects/b32fbe49b89845168fe881e3c1e56fc3/users/91db778b294849caab5e0e4ec971f8c7/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:20.694188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f9e91-ca56-4337-aa23-a99d996152b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b32fbe49b89845168fe881e3c1e56fc3, user_id=91db778b294849caab5e0e4ec971f8c7, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:20.695670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f9e91-ca56-4337-aa23-a99d996152b3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:20.712185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 590/1192] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:43:20 2022] PUT /identity/v3/projects/b32fbe49b89845168fe881e3c1e56fc3/users/91db778b294849caab5e0e4ec971f8c7/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:22.583981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c924-a00e-449b-9fc4-c8a63b52bf1c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.584543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c924-a00e-449b-9fc4-c8a63b52bf1c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.584543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c924-a00e-449b-9fc4-c8a63b52bf1c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.585911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 603/1193] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:22.592171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.592856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.593050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.617104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:22.618332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:22.687729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 591/1194] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:22.960338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c924-a00e-449b-9fc4-c8a63b52bf1c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.079371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c924-a00e-449b-9fc4-c8a63b52bf1c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.107000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.123025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.123956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.124341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.124715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.141911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:23.146757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:23.147891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:43:23.148949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 604/1195] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:23.154382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.177871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.281836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd505822-77e1-4251-9f74-b47ac60898d8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.323706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.324313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.324580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.324928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.325680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:23.326328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.328073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.340445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 592/1196] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:23.346955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.470419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a2e51-c1d6-496c-8b73-31bafc54e8a1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.515690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.516508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.516780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.517034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] PATH_INFO: `/v3/users/91db778b294849caab5e0e4ec971f8c7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.518226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] RBAC: Authorizing `identity:get_user(user_id=91db778b294849caab5e0e4ec971f8c7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.520084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.521757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 605/1197] 10.222.0.75 () {56 vars in 1177 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/users/91db778b294849caab5e0e4ec971f8c7 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:43:23.530121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.624253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.655646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4ef81-7827-41ca-a412-434366ef5bd7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.694749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.695369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.695637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.695931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.770652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.772035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.861844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.881300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 593/1198] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:23.890561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.949066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.996429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492f8ac-1101-4524-a3bc-e182937624bc None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:24.031564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d5920-2553-4e8c-acf9-675f1ae0f418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:24.032137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5920-2553-4e8c-acf9-675f1ae0f418 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:24.032412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5920-2553-4e8c-acf9-675f1ae0f418 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:24.032676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5920-2553-4e8c-acf9-675f1ae0f418 None admin] PATH_INFO: `/v3/projects/b32fbe49b89845168fe881e3c1e56fc3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:24.033964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d5920-2553-4e8c-acf9-675f1ae0f418 None admin] RBAC: Authorizing `identity:get_project(project_id=b32fbe49b89845168fe881e3c1e56fc3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:24.035425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d5920-2553-4e8c-acf9-675f1ae0f418 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:24.037078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 606/1199] 10.222.0.75 () {56 vars in 1186 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/projects/b32fbe49b89845168fe881e3c1e56fc3 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:24.049813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:24.162705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b51e3-2520-47f5-b733-3c0b663e2444 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:24.197713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:24.198371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:24.198645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:24.198912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:24.199628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=b32fbe49b89845168fe881e3c1e56fc3, user.id=91db778b294849caab5e0e4ec971f8c7) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:24.199933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:24.201397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14961c8a-1ac4-4ae6-9819-3a50bdfb51e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:24.207229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 594/1200] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:24 2022] GET /identity/v3/role_assignments?user.id=91db778b294849caab5e0e4ec971f8c7&scope.project.id=b32fbe49b89845168fe881e3c1e56fc3&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:34.026100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=39 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:34.204578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=77 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:19.721295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699276c6-8a1e-410d-9180-c3c3c51949a7 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:19.722021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699276c6-8a1e-410d-9180-c3c3c51949a7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:19.722021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699276c6-8a1e-410d-9180-c3c3c51949a7 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:19.723281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 607/1201] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:19.728885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:19.729413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:19.729413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:19.749524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:19.750870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:19.834235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 595/1202] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:20.126168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699276c6-8a1e-410d-9180-c3c3c51949a7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:20.271832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699276c6-8a1e-410d-9180-c3c3c51949a7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:20.324162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:20.324846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:20.325166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:20.325392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:20.341015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:20.342709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:20.362151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:20.363296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:20.364251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:20.364251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:20.364251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:20.364251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 608/1203] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:20.370074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:20.497552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bc76-2918-4c20-81de-9532c0ad26e2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:20.533198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:20.540736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:20.541461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:20.541863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:20.542233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:20.542805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:20.543078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:20.544489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210ba7-d2d1-47be-8067-e7c97d0f3335 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:20.560901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 596/1204] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:20.567508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:20.645192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:20.700138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6da8d-bad4-48f6-8bb6-f7b96803abc3 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:20.749175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e1e8c-be75-41b7-b26e-6aa9900b8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:20.749870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e1e8c-be75-41b7-b26e-6aa9900b8727 None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:20.750031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e1e8c-be75-41b7-b26e-6aa9900b8727 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:20.750309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e1e8c-be75-41b7-b26e-6aa9900b8727 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:20.751177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e1e8c-be75-41b7-b26e-6aa9900b8727 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:20.755851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e1e8c-be75-41b7-b26e-6aa9900b8727 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:20.780265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 609/1205] 10.222.0.75 () {60 vars in 1132 bytes} [Wed Aug 31 10:44:20 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:22.932137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19ce2-3af3-452f-a60b-973d08e5c35b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.933176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19ce2-3af3-452f-a60b-973d08e5c35b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.933176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19ce2-3af3-452f-a60b-973d08e5c35b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.934250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 597/1206] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:22.941805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.941805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.941805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.966440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:22.967690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:23.040073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 610/1207] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:23.318192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19ce2-3af3-452f-a60b-973d08e5c35b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.426548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f19ce2-3af3-452f-a60b-973d08e5c35b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.463675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.464421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.464884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.465160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.480989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:44:23.487031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:23.488097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:23.490608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 598/1208] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:23.494518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.540834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:23.612500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1cae4-1361-4fde-ab7b-79b0e33289a3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.649079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.649696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.650022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.650339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.651076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:23.651388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:23.652858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:23.664378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 611/1209] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:23.670350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.733219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:23.802301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5d916-0a5c-4ed5-ba7e-a276b5ed2f2c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.845317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.846174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.846535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.846831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.863654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:23.865382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:23.884936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:23.887752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:23.888871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:23.888871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:23.888871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:23.888871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 599/1210] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:23.893252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.011371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:24.014564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd997f-24b8-4d71-a48e-55f621a9e1ac None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.053338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.053992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.054268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.054536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.055189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:24.055499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.056843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.075435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 612/1211] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:24.075643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.193647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76d8c-b3fd-46b7-915c-99664117aff8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.195495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:24.237872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.238513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.238789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.239060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.248028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.249661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:44:24.261790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:24.267744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:24.268918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 600/1212] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:24.270560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.398589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4dd-9ac1-4187-b9a2-bb62680f3bf6 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.438823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.439615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.439979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.440349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.441518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:24.442007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.443583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.471956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 613/1213] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Aug 31 10:44:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:24.472178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.594602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885845b-339d-4067-a764-f7b40d7a9aeb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.634177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.635945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.635945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.635945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.678620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:24.726855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.728262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.863591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 601/1214] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:44:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:44:24.870328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.897969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:25.001757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a84ac-dcc2-48e0-81f6-322dd899c2a1 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.047549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772f9d-95a7-4061-996e-90137505022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.048249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772f9d-95a7-4061-996e-90137505022b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.048454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772f9d-95a7-4061-996e-90137505022b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.048726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772f9d-95a7-4061-996e-90137505022b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.061908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772f9d-95a7-4061-996e-90137505022b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.063422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772f9d-95a7-4061-996e-90137505022b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-58772f9d-95a7-4061-996e-90137505022b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:25.081558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:25.082877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:25.088660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:25.088660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:25.088660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:25.088660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 614/1215] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:44:25.091187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.171939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:25.213896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a130-004e-45f8-94ce-389cb9dfc78b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.250567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537672e2-2039-49d3-8383-60256149d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.251213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537672e2-2039-49d3-8383-60256149d05d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.251489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537672e2-2039-49d3-8383-60256149d05d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.251757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537672e2-2039-49d3-8383-60256149d05d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.252456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537672e2-2039-49d3-8383-60256149d05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:25.252696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537672e2-2039-49d3-8383-60256149d05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.254168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537672e2-2039-49d3-8383-60256149d05d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.270740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 602/1216] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:25.272772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772f9d-95a7-4061-996e-90137505022b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.359230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:25.406085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772f9d-95a7-4061-996e-90137505022b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.442106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.442738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.442999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.443275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.450763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.452222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:44:25.463639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:25.464624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:25.465511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 615/1217] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:25.472386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537672e2-2039-49d3-8383-60256149d05d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.578107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537672e2-2039-49d3-8383-60256149d05d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.603470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:25.615303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.615916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.616193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.616460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.617145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:25.617445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.618906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b79379-7a9d-4a17-8751-8c307ee2d760 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.633095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 603/1218] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:25.638806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.744347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d888b8-3224-46b0-932b-5455095dae0d None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.774045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:25.780786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.781483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.781871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.782238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.783018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=e5e980354e45478d8e78e510db208215) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:25.783460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.785083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4ba5-85f8-499d-9e22-6dfce96ba40d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.791951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 616/1219] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:44:25 2022] GET /identity/v3/role_assignments?user.id=e5e980354e45478d8e78e510db208215&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:27.783625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961de6-b2fa-43fa-bbff-d441499ddef1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:27.784264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961de6-b2fa-43fa-bbff-d441499ddef1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:27.784264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961de6-b2fa-43fa-bbff-d441499ddef1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:27.785790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 604/1220] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:27.792562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:27.792978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:27.793103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:27.818230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:27.819655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:27.894898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 617/1221] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:28.183399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93961de6-b2fa-43fa-bbff-d441499ddef1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:28.303958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93961de6-b2fa-43fa-bbff-d441499ddef1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:28.342885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:28.343517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:28.343841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:28.344113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:28.354630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:44:28.360237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:28.361715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:28.362784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 605/1222] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:28.368067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:28.471830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57ae1-9187-4b27-abd8-01a5bb843f6a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:28.496642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:28.508207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:28.508823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:28.509101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:28.509377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:28.510068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:28.510370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:28.511747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:28.520287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 618/1223] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:28.526084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:28.577865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:28.638536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83157ad3-e9ff-4973-b0c0-19c3f51b0a5a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:28.677208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:28.677891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:28.678166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:28.678430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:28.690943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:28.692836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:28.708503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:28.709828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:28.710758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:28.710758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:28.710758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:28.710758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 606/1224] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:28.715878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:28.826221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c57c-0280-4e37-bde9-14bc6e33b9ff None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:28.865805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:28.866438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:28.866815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:28.867188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:28.867923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:28.868227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:28.869822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:28.883389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 619/1225] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:28.889907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:28.989209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:28.996514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae69e8-fbd5-46eb-a5e6-dcdef2f5da1b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.031057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.031685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.031961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.032223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.042045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.044238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:44:29.066316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:29.068004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:29.069025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 607/1226] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:44:29.074039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.123911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:29.180640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f526623-93c1-43f9-b278-b6e0aa242f61 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.219646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.220233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.220505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.220771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.221477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:29.221812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.223331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.242345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 620/1227] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Aug 31 10:44:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:29.248809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.370649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030ff77-d1d0-4870-8847-811880f2ae15 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.411028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.411781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.412136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.412405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.425199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.427027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:29.442663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:29.443718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:29.444639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:29.444639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:29.444639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:29.444639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 608/1228] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:29.450412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.558805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fb992-9fa3-428b-8003-5bf78e88cc92 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.561421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:29.594615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.595503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.595739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.595968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.596791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:29.597122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.598804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.612033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 621/1229] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:29.618150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.629081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:29.732824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58151d-be31-4d9d-8cb2-03d325693e79 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.768895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.769564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.769875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.770235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.777217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.778897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:44:29.791123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:29.792342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:29.793585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 609/1230] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:29.798874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.909340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff98f5-e860-4888-bd74-fe669baeca23 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.948059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.948742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.949049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.949326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.950107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:29.950415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.951858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693163a-5079-460c-8fb3-8ccbb59774ce None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.964450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 622/1231] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:29.970805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:30.040986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:30.078177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3989ef-af97-4665-af67-f97804f4e4de None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:30.112627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183fa55-2647-461e-be04-b760305a3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:30.113284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183fa55-2647-461e-be04-b760305a3d05 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:30.113553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183fa55-2647-461e-be04-b760305a3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:30.113947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183fa55-2647-461e-be04-b760305a3d05 None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/e5e980354e45478d8e78e510db208215/roles/0ba00978132e484e82ba49350df71a08` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:30.128562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183fa55-2647-461e-be04-b760305a3d05 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=e5e980354e45478d8e78e510db208215, role_id=0ba00978132e484e82ba49350df71a08)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:30.130141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183fa55-2647-461e-be04-b760305a3d05 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:30.145641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 610/1232] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:44:29 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/e5e980354e45478d8e78e510db208215/roles/0ba00978132e484e82ba49350df71a08 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:32.067087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0bff-68f9-45dc-9680-798dfd94d92b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.067668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0bff-68f9-45dc-9680-798dfd94d92b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.067788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0bff-68f9-45dc-9680-798dfd94d92b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.070051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 623/1233] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:32.075693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.076174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.076174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.095362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:32.096613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:32.165848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 611/1234] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:32.469164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d0bff-68f9-45dc-9680-798dfd94d92b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.496020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:32.579874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d0bff-68f9-45dc-9680-798dfd94d92b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:32.614302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:32.614942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.615220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.615492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.626321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:44:32.631249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:32.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:32.638277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 624/1235] 10.222.0.75 () {56 vars in 1102 bytes} [Wed Aug 31 10:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:32.639129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.696679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:32.762774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa045af-5fc1-42f0-94ab-9aa3df194d66 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:32.798555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:32.799163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.799443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.799728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.800387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:32.800677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:32.802162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:32.815931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 612/1236] 10.222.0.75 () {56 vars in 1103 bytes} [Wed Aug 31 10:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:32.817600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.904830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:32.922292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969111c-b3a2-4750-9c1e-358e58746fa8 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:32.962033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:32.962968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.963432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.963670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.975155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:32.976782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:32.992530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:32.993655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:32.994756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:32.994756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:32.994756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:32.994756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 625/1237] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:32.999672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.106980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056362c2-18c0-4682-8025-a1d7936402a4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.116409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:33.145212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.145943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.146217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.146502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.147140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:33.147434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.148796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.161410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 613/1238] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:33.167661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.311145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fc70-ce65-4297-bb13-57fd7f3d830f None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.358711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.359190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.359657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.359966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.363368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:33.369046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.370808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:44:33.383415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:33.384389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:33.385406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 626/1239] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:33.391100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.498617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07793a7-fd2b-4989-bd5b-1060efc82821 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.537464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.538111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.538381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.538642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.539364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:33.539659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.541077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.559328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 614/1240] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:33.565434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.676407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b438b-39a1-4a5c-b39c-c1e0ee4480c7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.712670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.713208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.713524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.713788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.778470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:33.786029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.787553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.897496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 627/1241] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:44:33.903607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.938043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.021888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8768-384a-44c1-9949-9439a189a6d0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.059940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.060581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.060851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.061112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.074560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.076032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:34.094368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:34.095641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:34.096917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:34.096917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:34.096917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:34.096917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 615/1242] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:34.101533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.210946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.217730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9b18-30bd-4d27-a9db-5d5ee6df19d2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.260611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.261240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.261505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.261800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.262453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:34.262755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.264150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.277143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 628/1243] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:44:34.283079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.404024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.436835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ff84-81a7-4cd5-af0b-53fd5efc9f75 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.476806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72144-4d2c-4709-b942-992d900c738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.477371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72144-4d2c-4709-b942-992d900c738b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.477711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72144-4d2c-4709-b942-992d900c738b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.478048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72144-4d2c-4709-b942-992d900c738b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.486415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def72144-4d2c-4709-b942-992d900c738b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.487949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def72144-4d2c-4709-b942-992d900c738b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-def72144-4d2c-4709-b942-992d900c738b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:44:34.500560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:34.501546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:34.502530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 616/1244] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:34.507899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.618886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69321d-cb7e-43be-be6a-40cd3d928fbd None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.656513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.657115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.657386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.657653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.658363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:34.658659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.660086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44890d-1889-48fa-9472-9eb1615cff8d None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.672066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 629/1245] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:44:34.678359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72144-4d2c-4709-b942-992d900c738b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.788489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72144-4d2c-4709-b942-992d900c738b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.823329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.823959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.824215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.824482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.825224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] RBAC: Adding query filter params (role.id=0ba00978132e484e82ba49350df71a08, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=e5e980354e45478d8e78e510db208215) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:34.825523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.826977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c3a36-1032-48cc-b1e0-0f80bf872622 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.833463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 617/1246] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/role_assignments?user.id=e5e980354e45478d8e78e510db208215&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=0ba00978132e484e82ba49350df71a08 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:36.883686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570f2b-3620-483e-83c2-d1a696016237 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.884284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570f2b-3620-483e-83c2-d1a696016237 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.884284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570f2b-3620-483e-83c2-d1a696016237 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.885552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 630/1247] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:36.891071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.891534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.891738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.898384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:36.913221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:36.914426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.987282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 618/1248] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:37.266149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570f2b-3620-483e-83c2-d1a696016237 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.287536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:37.407304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570f2b-3620-483e-83c2-d1a696016237 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.447909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.448590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.448962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.449246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.462129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:44:37.468221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:37.469325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:37.470314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 631/1249] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:37.475764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.596782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b88a24-ddb5-4f8a-abe1-eea030455728 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.626668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:37.631545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.632184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.632438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.632708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.633368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:37.633665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.635060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.643312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 619/1250] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:37.649654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.737133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:37.763360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ebf65-8406-4c89-8230-6f228b9d29f2 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.804584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.805225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.805502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.805858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.818640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.820325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:37.838770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:37.840007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:37.841041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:37.841041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:37.841041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:37.841216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 632/1251] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:37.846448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.956605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819ffc-186c-4f2e-b391-6466bd20fe0a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.995228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.995859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.996150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.996416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.997084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:37.997416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.998965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.019822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 620/1252] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:38.026620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.137377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c45ee-8934-4e60-968b-65212b011eac None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.166469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.177241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.177908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.178187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.178478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.187155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.188613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:44:38.200660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:38.201911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:38.203279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 633/1253] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:38.208619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.266700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.323401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59844-095c-4014-8a7a-5e8f7375dc1b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.370672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.372793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.372793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.372793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.372793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:38.372793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.374256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.393203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 621/1254] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:44:38.399407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.525618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5812e2-e758-4c3a-af23-a803050ea974 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.562373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.563025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.563385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.563683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.628774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.645316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.647054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.767731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 634/1255] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:44:38.775035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.902827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12f992-bde8-4d8f-b201-bef8b4db12ad None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.920597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.944398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.945037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.945313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.945578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.956359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.957877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:38.974400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:38.975532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:38.976480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:38.976480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:38.976480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:38.976480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 622/1256] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:38.982741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.083941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:39.098066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062b2e7-ff33-4ffc-9f76-3219f1922931 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.135985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.136600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.136866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.137134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.137803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:39.138099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.139475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.150929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 635/1257] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:39.156960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.262748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1e89-451c-4581-b6f3-cc9252560086 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.299796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.300458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.300693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.300957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.308627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.310114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:44:39.322537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:39.323691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:39.324652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 623/1258] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:39.330218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.436410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483dbf-60c0-4820-96fe-2e45a47b8883 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.469959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.470711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.470988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.471255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.471962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:39.472266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.473730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005dd05-1c1f-4025-a204-56c390a93dd5 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.489567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 636/1259] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:39.495777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.522420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:39.615661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd804d-ec70-4a65-b2e8-a2271e72360a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.653627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.654264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.654533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.654794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.655517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=e5e980354e45478d8e78e510db208215) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:39.655812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.657292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60aadd-ac43-4911-9581-83e18d2bc560 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.662995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 624/1260] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:44:39 2022] GET /identity/v3/role_assignments?user.id=e5e980354e45478d8e78e510db208215&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:41.598659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40beb-eb5a-431b-a6eb-5e009066b38c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.599420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40beb-eb5a-431b-a6eb-5e009066b38c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.599420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40beb-eb5a-431b-a6eb-5e009066b38c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.600779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 637/1261] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:41.609506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.610311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.610431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.637924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:41.639165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:41.712143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 625/1262] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:41.974791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40beb-eb5a-431b-a6eb-5e009066b38c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.991996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.091078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40beb-eb5a-431b-a6eb-5e009066b38c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.126168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.126790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.127068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.127338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.137907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:44:42.142751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:42.143797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:42.144844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 638/1263] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:42.152319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.171728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.256527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b062dc-a190-407c-b455-e859d4ecc8a1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.293811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.294423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.294695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.294963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.295626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:42.295921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.297315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.306290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 626/1264] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:42.313279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.389053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.424350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b1441-991a-45a3-85e5-24c10f80ea1a None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.459559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.460215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.460482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.460748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.471308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.472756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:42.487481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:42.488544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:42.489648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:42.489648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:42.489648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:42.489648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 639/1265] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:42.494647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.580996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.605099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada2528-096a-4f0f-be19-f9095d94f688 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.638900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.639536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.639753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.640015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.640707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:42.641064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.642516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.654453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 627/1266] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:42.660342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.767231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386245a7-d352-4b70-9647-6bb0751d8e81 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.788022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.803520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.804142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.804418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.804684 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.812359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.813809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:44:42.825414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:42.826431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:42.827414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:42.829968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 640/1267] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:42.833089 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.939187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03371c7-4560-42a4-bf06-70467a16dbcb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.975015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.975584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.975856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.976120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.976841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:42.977137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.978588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.987256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.997437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 628/1268] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:43.003915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.110251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd20e4-fd1f-4048-8492-084ba76ab6d0 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.145486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.146175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.146453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.146728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.157549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.159035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:43.173431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:43.174526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:43.175650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:43.175650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:43.175650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:43.175650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 641/1269] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:43.183796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.306948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7422cd-178d-4e6e-806d-ac35dbc195ff None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.345078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.345698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.346000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.346272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.346912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:43.347219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.348572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.362269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 629/1270] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:43.368267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.402055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:43.471601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eef4e-3a38-4a86-93d1-388968af4cf7 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.506113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.506720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.506991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.507259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.514604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.516034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:44:43.527582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:43.528605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:43.529716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 642/1271] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:43.537287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.605345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:43.648373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8453c-6ad1-4f5b-b5a9-c0586d417b61 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.685430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.686072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.686341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.686611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.687295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:43.687596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.689016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cb4cd-f350-4040-a0fa-b699e4bf5737 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.703692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 630/1272] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:43.710546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.812832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:43.823145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8199-0ff3-4ae8-967a-525fe3602c69 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.862730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26c119-4838-4586-89cb-e31f16615396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.863400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26c119-4838-4586-89cb-e31f16615396 None admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.863683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26c119-4838-4586-89cb-e31f16615396 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.863959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26c119-4838-4586-89cb-e31f16615396 None admin] PATH_INFO: `/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/e5e980354e45478d8e78e510db208215/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.865901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26c119-4838-4586-89cb-e31f16615396 None admin] RBAC: Authorizing `identity:create_grant(project_id=42bc3b4563aa495480ed7397857e74b7, user_id=e5e980354e45478d8e78e510db208215, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.867358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26c119-4838-4586-89cb-e31f16615396 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.881927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 643/1273] 10.222.0.75 () {58 vars in 1439 bytes} [Wed Aug 31 10:44:43 2022] PUT /identity/v3/projects/42bc3b4563aa495480ed7397857e74b7/users/e5e980354e45478d8e78e510db208215/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:45.754048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb96d8-064e-42ac-8ec4-eec42150a41e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.755000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb96d8-064e-42ac-8ec4-eec42150a41e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.755000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb96d8-064e-42ac-8ec4-eec42150a41e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.757187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 631/1274] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:45.765764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.766334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.766419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.787318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:45.788508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:45.860080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 644/1275] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:46.131965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb96d8-064e-42ac-8ec4-eec42150a41e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.251191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb96d8-064e-42ac-8ec4-eec42150a41e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.268594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:46.287164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.287783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.288052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.288318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.300086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:44:46.305193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:46.306615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:46.308055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 632/1276] 10.222.0.75 () {56 vars in 1096 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:46.313132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.398513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:46.416881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ccd84-03ea-437d-804c-ce3184d9ac83 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.449688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.450320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.450592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.450861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.451520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:46.451815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.453209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.460977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 645/1277] 10.222.0.75 () {56 vars in 1099 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:46.470053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.585279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd33b5f-c258-4c8b-a5e3-9bc46d6daea6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.619321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.619942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.620221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.620482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.630897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.632333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:46.646224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:46.647338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:46.648611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:46.648611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:46.648611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:46.648611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 633/1278] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:46.653507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.768678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab52645-8e7f-4676-8c04-0acb3ccf068b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.803119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.803717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.803993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.804264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.804883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:46.805179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.806586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.818576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 646/1279] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:46.827003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.868988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:46.947487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ea6-94fe-4015-96c3-914797f03ff4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.983145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.983755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.984026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.984287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.991872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.993292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:44:47.004722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:47.005844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:47.007512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 634/1280] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:47.014676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.020920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.123902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee343e-6e9c-4ef0-a9b2-c560d750164b None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.160783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.161366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.161673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.161974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.162689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:47.162986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.164426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.180833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 647/1281] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:47.190223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.290334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.300811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3030d-72ac-4856-88fa-6aac041e7e32 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.336114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.336706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.336980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.337244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.410423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.411916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.513421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.525471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 635/1282] 10.222.0.75 () {58 vars in 1282 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:44:47.532157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.601701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.646608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93068855-02a8-42d9-8bbb-cee2456e25a9 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.681942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.682555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.682827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.683100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.693707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.695197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:44:47.709862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:47.710917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:44:47.711955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:44:47.711955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:44:47.711955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:47.713949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 648/1283] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:47.716609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.826395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356cd7-67a5-4845-99b7-6b46fe3644b4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.864147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.864780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.865032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.865262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.865919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:47.866216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.867566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.879206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 636/1284] 10.222.0.75 () {56 vars in 1109 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:47.885304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.991820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b874-f150-4887-b992-a337ad466944 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:48.006997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:48.030180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:48.030728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:48.031050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:48.031272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:48.038396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:48.039839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:44:48.054245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:48.055288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: ERROR keystone.server.flask.application Aug 31 10:44:48.056313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 649/1285] 10.222.0.75 () {56 vars in 1111 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:48.061544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:48.118576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:48.176130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d8f94-24fd-4310-b208-bfe945430bef None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:48.212827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:48.213421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:48.213695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:48.213997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:48.214680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:48.214979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:48.216406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d67cb9-4d5b-4c82-b0b4-77f9a3272814 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.228522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 637/1286] 10.222.0.75 () {56 vars in 1148 bytes} [Wed Aug 31 10:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:48.235490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:48.354372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01186160-1049-41f3-85a3-9b03733b9efb None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:48.391204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:48.391725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:48.391997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:48.392259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:48.392961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] RBAC: Adding query filter params (role.id=3220c969e78d4e839bfa6b8c6235cd2b, scope.project.id=42bc3b4563aa495480ed7397857e74b7, user.id=e5e980354e45478d8e78e510db208215) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:48.393268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:48.394809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8a19c-12ff-443f-b2d9-00ea6ce1bc1f None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.400645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 650/1287] 10.222.0.75 () {56 vars in 1374 bytes} [Wed Aug 31 10:44:48 2022] GET /identity/v3/role_assignments?user.id=e5e980354e45478d8e78e510db208215&scope.project.id=42bc3b4563aa495480ed7397857e74b7&role.id=3220c969e78d4e839bfa6b8c6235cd2b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:50.296613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21527f-76dc-487f-a35b-fc0705b81808 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.297170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21527f-76dc-487f-a35b-fc0705b81808 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.297170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21527f-76dc-487f-a35b-fc0705b81808 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.298518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 638/1288] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:50.304856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.305628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.305752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.334699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:50.335988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.367558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:50.416116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 651/1289] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:50.685991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21527f-76dc-487f-a35b-fc0705b81808 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.792388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21527f-76dc-487f-a35b-fc0705b81808 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.803378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:50.829488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.830184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.830464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.830739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.831428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.833698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:50.843655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:50.844885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:50.845836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 639/1290] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:44:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:50.851047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.957397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49933d41-ef74-407c-8e89-e535eb6d8bfd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.996367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.997046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.997401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.997671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.998311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:50.998600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.999973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86234db5-f1b0-4853-9419-86aff7c355ca None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.004856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 652/1291] 10.222.0.75 () {56 vars in 1116 bytes} [Wed Aug 31 10:44:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:51.011154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.113836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9377fcf-db4a-4704-af98-aa928d358fa7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.148796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.149392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.149662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.149944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.150568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:51.150861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.152211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cacd1-47d8-4f59-ba54-1beb1a53bc9a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.157795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 640/1292] 10.222.0.75 () {56 vars in 1116 bytes} [Wed Aug 31 10:44:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:53.061874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced1ce4-0a9c-41d2-8eca-de388e1077c1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.062794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced1ce4-0a9c-41d2-8eca-de388e1077c1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.062794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced1ce4-0a9c-41d2-8eca-de388e1077c1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.064921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 653/1293] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:53.073978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906132-13bd-4848-8ef1-f4f4db05d314 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.074425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906132-13bd-4848-8ef1-f4f4db05d314 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.074533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906132-13bd-4848-8ef1-f4f4db05d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.099185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6c906132-13bd-4848-8ef1-f4f4db05d314 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:53.100378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6c906132-13bd-4848-8ef1-f4f4db05d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:53.133988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:53.172936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 641/1294] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:53.454721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced1ce4-0a9c-41d2-8eca-de388e1077c1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.507320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:53.588585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced1ce4-0a9c-41d2-8eca-de388e1077c1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.622700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d528cf-68cb-4985-8c0e-dffd012fc71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.623330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d528cf-68cb-4985-8c0e-dffd012fc71c None admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.623614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d528cf-68cb-4985-8c0e-dffd012fc71c None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.623879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d528cf-68cb-4985-8c0e-dffd012fc71c None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.624532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d528cf-68cb-4985-8c0e-dffd012fc71c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.625965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d528cf-68cb-4985-8c0e-dffd012fc71c None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.644033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 654/1295] 10.222.0.75 () {60 vars in 1141 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:55.554169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa322f8b-d03b-445f-b593-72966dab70ed None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.554747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa322f8b-d03b-445f-b593-72966dab70ed None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.554747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa322f8b-d03b-445f-b593-72966dab70ed None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.556087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 642/1296] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:55.562496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.563232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.563377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.591322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:55.592541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.678664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 655/1297] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:55.943765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa322f8b-d03b-445f-b593-72966dab70ed None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.049997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa322f8b-d03b-445f-b593-72966dab70ed None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.088299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.088913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.089184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.089446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.090048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.091423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:56.100703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:56.101992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:56.102972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 643/1298] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:44:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:56.108060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.128488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.214693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e085073-1a9c-4bb9-9804-02f015ee7401 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.261864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.262464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.262739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.263009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.263635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:56.263930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.265307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.270673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 656/1299] 10.222.0.75 () {56 vars in 1116 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:56.276934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.313707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.387693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890bad0-9c5c-4787-b7fc-3c01f53aa73e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.422523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.423122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.423406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.423679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.424370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] RBAC: Adding query filter params (interface=public, service_id=664052e39cd948b38df9f367ef026ed0, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:56.424677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.426070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff66f4-3f6b-449d-a648-6d478fdddd96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.431222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 644/1300] 10.222.0.75 () {56 vars in 1251 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/endpoints?service_id=664052e39cd948b38df9f367ef026ed0&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:56.437325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.521111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.542119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501b2d-7137-493c-b65b-63a1eb676792 None admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.577850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203a5a2-8853-4e92-bccc-f149f762ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.578514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203a5a2-8853-4e92-bccc-f149f762ba6b None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.578732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203a5a2-8853-4e92-bccc-f149f762ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.578985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203a5a2-8853-4e92-bccc-f149f762ba6b None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.579581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203a5a2-8853-4e92-bccc-f149f762ba6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.580970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203a5a2-8853-4e92-bccc-f149f762ba6b None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.589803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 657/1301] 10.222.0.75 () {56 vars in 1087 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:58.462604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e122e-3751-4bcd-a1cd-46cb28294fa3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:58.463448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e122e-3751-4bcd-a1cd-46cb28294fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:58.463448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e122e-3751-4bcd-a1cd-46cb28294fa3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:58.465588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 645/1302] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:58.474176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:58.474590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:58.474763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:58.499909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:58.501097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:58.582864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 658/1303] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:44:58.851065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e122e-3751-4bcd-a1cd-46cb28294fa3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:58.952787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:58.961804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e122e-3751-4bcd-a1cd-46cb28294fa3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:59.003801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:59.004432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:59.004692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:59.004960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:59.005537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:59.006944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:44:59.016016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:44:59.017169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:44:59.018133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 646/1304] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Aug 31 10:44:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:44:59.023593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:59.105341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:59.134587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca5a26-e0dc-445a-9c16-3dc58ca2f256 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:59.169412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:59.170045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:59.170323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:59.170595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] PATH_INFO: `/v3/services` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:59.171217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:59.171516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:59.172895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876d5a-30f0-4614-914f-a913fb540021 None admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:59.178145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 659/1305] 10.222.0.75 () {56 vars in 1116 bytes} [Wed Aug 31 10:44:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:59.186930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:59.297187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620542b-ffec-40be-973e-075fa5145121 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:59.343552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8fa3f-a771-46b9-a107-08b22625be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:59.344430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8fa3f-a771-46b9-a107-08b22625be93 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:59.344812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8fa3f-a771-46b9-a107-08b22625be93 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:59.345155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8fa3f-a771-46b9-a107-08b22625be93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:59.346228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8fa3f-a771-46b9-a107-08b22625be93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:59.348281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8fa3f-a771-46b9-a107-08b22625be93 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:59.374511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 647/1306] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:09.174996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=30 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:09.368489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:03.883437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c05c-c48e-41ef-970a-a2d366a3f47d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:03.884013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c05c-c48e-41ef-970a-a2d366a3f47d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:03.884013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c05c-c48e-41ef-970a-a2d366a3f47d None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:03.885654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 660/1307] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:03.891563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9b38-05c7-481b-90e9-895c4007c3c1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:03.892030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9b38-05c7-481b-90e9-895c4007c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:03.892245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9b38-05c7-481b-90e9-895c4007c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:03.978566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2fdf9b38-05c7-481b-90e9-895c4007c3c1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:03.979758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2fdf9b38-05c7-481b-90e9-895c4007c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.117828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 648/1308] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:04.402528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a88a1c-5a2f-43b4-b631-ba8fba059789 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.402875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a88a1c-5a2f-43b4-b631-ba8fba059789 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.403059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a88a1c-5a2f-43b4-b631-ba8fba059789 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.404638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 661/1309] 10.222.0.75 () {54 vars in 965 bytes} [Wed Aug 31 10:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:04.410785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa057c8-a126-47b2-9efb-20561adda760 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.411077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa057c8-a126-47b2-9efb-20561adda760 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.411349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa057c8-a126-47b2-9efb-20561adda760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.491056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-faa057c8-a126-47b2-9efb-20561adda760 None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:04.492260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-faa057c8-a126-47b2-9efb-20561adda760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.514386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:04.577509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 649/1310] 10.222.0.75 () {58 vars in 1062 bytes} [Wed Aug 31 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:04.587277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a88a1c-5a2f-43b4-b631-ba8fba059789 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:04.589264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-39a88a1c-5a2f-43b4-b631-ba8fba059789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.712485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a88a1c-5a2f-43b4-b631-ba8fba059789 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:04.792731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:04.793328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.793601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.793892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.795461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.858906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:04.925957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:04.927404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e312f2-e0d7-4c72-9176-3ab16f568536 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:04.947541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 662/1311] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:07.175848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b16c-8620-4756-9117-3f27830186d3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:07.176414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b16c-8620-4756-9117-3f27830186d3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:07.176414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b16c-8620-4756-9117-3f27830186d3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:07.177749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 650/1312] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:07.183964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a4ab-2b3e-49c8-9693-9ffa76f2d2ea None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:07.184566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a4ab-2b3e-49c8-9693-9ffa76f2d2ea None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:07.184912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a4ab-2b3e-49c8-9693-9ffa76f2d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:07.268159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8899a4ab-2b3e-49c8-9693-9ffa76f2d2ea None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:07.269368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8899a4ab-2b3e-49c8-9693-9ffa76f2d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:07.379101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 663/1313] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:07.661723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b16c-8620-4756-9117-3f27830186d3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:07.664312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ca58b16c-8620-4756-9117-3f27830186d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:07.784282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b16c-8620-4756-9117-3f27830186d3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:07.859694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:07.862722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:07.863661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:07.863951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:07.864443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:07.866435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:07.985062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:07.986555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6578637-d606-4454-ad16-150c23e4986c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:08.007228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 651/1314] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:10.262509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a9028-9c4a-4168-8b8c-28889c9a76cd None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:10.263456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a9028-9c4a-4168-8b8c-28889c9a76cd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:10.263456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a9028-9c4a-4168-8b8c-28889c9a76cd None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:10.265660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 664/1315] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:10.271978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae138eb2-e940-4657-a07e-7cb40cd2140b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:10.272768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae138eb2-e940-4657-a07e-7cb40cd2140b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:10.272899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae138eb2-e940-4657-a07e-7cb40cd2140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:10.344345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ae138eb2-e940-4657-a07e-7cb40cd2140b None None] MFA Rules not processed for user `cf9ab79962264150b479a8b5c3cbbfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:10.345561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae138eb2-e940-4657-a07e-7cb40cd2140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:10.397239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:10.443957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 652/1316] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:10.731977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a9028-9c4a-4168-8b8c-28889c9a76cd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:10.734472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e16a9028-9c4a-4168-8b8c-28889c9a76cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:10.746884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:10.850044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a9028-9c4a-4168-8b8c-28889c9a76cd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:10.929152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:10.930128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:10.930528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:10.930942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:10.933696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:11.006496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:11.055331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:11.056824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb46b2-7188-4cc1-8240-abe43469475d service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:11.075983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 665/1317] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:13.549030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5504a-fc19-45dd-9993-460f7869ded2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:13.549683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5504a-fc19-45dd-9993-460f7869ded2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:13.549683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5504a-fc19-45dd-9993-460f7869ded2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:13.551119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 653/1318] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:13.558996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804d2d-db6a-4e64-9774-5534e19994fa None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:13.559651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804d2d-db6a-4e64-9774-5534e19994fa None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:13.559872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52804d2d-db6a-4e64-9774-5534e19994fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:13.630313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-52804d2d-db6a-4e64-9774-5534e19994fa None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:13.631524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-52804d2d-db6a-4e64-9774-5534e19994fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:13.731913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 666/1319] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:14.013033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5504a-fc19-45dd-9993-460f7869ded2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:14.014631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a2c5504a-fc19-45dd-9993-460f7869ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:14.129282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5504a-fc19-45dd-9993-460f7869ded2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:14.208050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:14.208654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:14.208928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:14.209197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:14.210818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:14.218728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:14.330513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:14.331868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac565a6-8b82-4d7c-8726-94bc33f5215e service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:14.350108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 654/1320] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:16.919365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe92d2-4e22-4a97-a3b1-e68e60a7bf17 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:16.919900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe92d2-4e22-4a97-a3b1-e68e60a7bf17 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:16.919900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe92d2-4e22-4a97-a3b1-e68e60a7bf17 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:16.921312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 667/1321] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:16.926900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aab37d-0657-49da-bde7-e877467cbdf5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:16.927288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aab37d-0657-49da-bde7-e877467cbdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:16.927434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aab37d-0657-49da-bde7-e877467cbdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:16.998426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e7aab37d-0657-49da-bde7-e877467cbdf5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:16.999606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e7aab37d-0657-49da-bde7-e877467cbdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:17.058206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:17.098493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 655/1322] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:17.381299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe92d2-4e22-4a97-a3b1-e68e60a7bf17 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:17.383346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eebe92d2-4e22-4a97-a3b1-e68e60a7bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:17.403536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:17.495665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe92d2-4e22-4a97-a3b1-e68e60a7bf17 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:17.573204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:17.573737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:17.574055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:17.574321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:17.576016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:17.652110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:17.692369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:17.693863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb20d4f-399f-465f-9c67-b265c3bb05be service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:17.713314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 668/1323] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:19.676178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364ea70-cea6-488d-9908-f5dfcd8c03c4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:19.676762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364ea70-cea6-488d-9908-f5dfcd8c03c4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:19.676762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364ea70-cea6-488d-9908-f5dfcd8c03c4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:19.678102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 656/1324] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:19.683344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3259-9846-470b-a5d9-27dbf25dcf20 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:19.683790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3259-9846-470b-a5d9-27dbf25dcf20 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:19.683876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3259-9846-470b-a5d9-27dbf25dcf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:19.750653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13fa3259-9846-470b-a5d9-27dbf25dcf20 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:19.751839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13fa3259-9846-470b-a5d9-27dbf25dcf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:19.854455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 669/1325] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:20.133174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364ea70-cea6-488d-9908-f5dfcd8c03c4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:20.134812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c364ea70-cea6-488d-9908-f5dfcd8c03c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:20.254193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364ea70-cea6-488d-9908-f5dfcd8c03c4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:20.331203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:20.332041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:20.332340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:20.332611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:20.334249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:20.351924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:20.447015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:20.448850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449f065-eddc-4de1-9e22-da9e8f37e8fb service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:20.467553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 657/1326] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:22.420074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976defe-07de-4cd1-a644-5d3519913551 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:22.420659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976defe-07de-4cd1-a644-5d3519913551 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:22.420659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976defe-07de-4cd1-a644-5d3519913551 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:22.422043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 670/1327] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:22.427963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363eaac-d261-4dba-a568-ed2ca9e9458e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:22.428596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363eaac-d261-4dba-a568-ed2ca9e9458e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:22.428596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363eaac-d261-4dba-a568-ed2ca9e9458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:22.499340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f363eaac-d261-4dba-a568-ed2ca9e9458e None None] MFA Rules not processed for user `cf9ab79962264150b479a8b5c3cbbfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:22.500585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f363eaac-d261-4dba-a568-ed2ca9e9458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:22.565761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:22.601291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 658/1328] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:22.884834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976defe-07de-4cd1-a644-5d3519913551 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:22.886391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e976defe-07de-4cd1-a644-5d3519913551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:22.918417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:22.993225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976defe-07de-4cd1-a644-5d3519913551 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:23.068176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:23.068719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:23.068996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:23.069229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:23.070881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:23.175324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:23.210131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:23.211613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e263e-f00e-4431-b288-8d715fe9ad09 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:23.230305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 671/1329] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:25.360837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599575cb-1e8e-4e92-b27e-d9833e76cb7b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:25.361556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599575cb-1e8e-4e92-b27e-d9833e76cb7b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:25.361556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599575cb-1e8e-4e92-b27e-d9833e76cb7b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:25.362791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 659/1330] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:25.369439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2752-cca5-4e3a-ad68-b1b6e58529d9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:25.370214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2752-cca5-4e3a-ad68-b1b6e58529d9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:25.370408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2752-cca5-4e3a-ad68-b1b6e58529d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:25.449301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5e6c2752-cca5-4e3a-ad68-b1b6e58529d9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:25.450592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5e6c2752-cca5-4e3a-ad68-b1b6e58529d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:25.552546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 672/1331] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:25.833254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599575cb-1e8e-4e92-b27e-d9833e76cb7b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:25.835211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-599575cb-1e8e-4e92-b27e-d9833e76cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:25.942184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599575cb-1e8e-4e92-b27e-d9833e76cb7b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:26.032524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:26.033138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:26.033407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:26.033670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:26.035282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:26.066416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:26.168912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:26.170382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d429b-6d23-46ae-a5c6-0df70f457300 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:26.188529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 660/1332] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:28.124725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d062e-c88b-45f4-85ba-06677d9cada9 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.125568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d062e-c88b-45f4-85ba-06677d9cada9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.125568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d062e-c88b-45f4-85ba-06677d9cada9 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:28.127700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 673/1333] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:28.135314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4d65-d4ad-4da9-925e-dbdad8ea770f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.135783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4d65-d4ad-4da9-925e-dbdad8ea770f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.135875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4d65-d4ad-4da9-925e-dbdad8ea770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:28.225685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2ddb4d65-d4ad-4da9-925e-dbdad8ea770f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:28.228093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2ddb4d65-d4ad-4da9-925e-dbdad8ea770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:28.338692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:28.370116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 661/1334] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:28.652848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d062e-c88b-45f4-85ba-06677d9cada9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:28.654432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ab7d062e-c88b-45f4-85ba-06677d9cada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:28.696552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:28.761274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d062e-c88b-45f4-85ba-06677d9cada9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:28.839007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:28.839618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.839889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.840154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:28.842151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:28.945284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:28.973901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:28.975367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fade5-d467-4e34-b52f-2e678f591e99 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:28.994373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 674/1335] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:31.247536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6966daf-bfc8-4c08-81b6-48e7f29f0c4b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:31.248430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6966daf-bfc8-4c08-81b6-48e7f29f0c4b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:31.248430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6966daf-bfc8-4c08-81b6-48e7f29f0c4b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:31.250681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 662/1336] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:31.256888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a2298-5a8c-4f62-b46c-52930d119774 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:31.257345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a2298-5a8c-4f62-b46c-52930d119774 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:31.257441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a2298-5a8c-4f62-b46c-52930d119774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:31.340299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3b0a2298-5a8c-4f62-b46c-52930d119774 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:31.341603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3b0a2298-5a8c-4f62-b46c-52930d119774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:31.454812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 675/1337] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:31.734360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6966daf-bfc8-4c08-81b6-48e7f29f0c4b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:31.736681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a6966daf-bfc8-4c08-81b6-48e7f29f0c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:31.855780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6966daf-bfc8-4c08-81b6-48e7f29f0c4b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:31.938608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:31.939225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:31.939498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:31.939763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:31.941328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:31.979612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:32.067791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:32.069217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8b8-83d5-4ef3-a23c-72f057143e0d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:32.087775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 663/1338] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:35.953418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0744f63-10f0-4696-b844-85703ed5ca26 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:35.953983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0744f63-10f0-4696-b844-85703ed5ca26 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:35.954100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0744f63-10f0-4696-b844-85703ed5ca26 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:35.955496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 676/1339] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:46:35.961212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa26d0-96b1-4084-8198-4d554cb8622b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:35.961684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa26d0-96b1-4084-8198-4d554cb8622b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:35.961837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa26d0-96b1-4084-8198-4d554cb8622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:36.029157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a8aa26d0-96b1-4084-8198-4d554cb8622b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:36.030446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8aa26d0-96b1-4084-8198-4d554cb8622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:36.117829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:36.129987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 664/1340] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:36.412509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0744f63-10f0-4696-b844-85703ed5ca26 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:36.414188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f0744f63-10f0-4696-b844-85703ed5ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:36.465101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:36.525596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0744f63-10f0-4696-b844-85703ed5ca26 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:36.601544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:36.602195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:36.602468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:36.602734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:36.604333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:36.702297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:36.720173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:36.721762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c44c9-ba9a-444c-b58b-e06dbc31da8a service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:36.740154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 677/1341] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:39.300453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f0893-6e61-45a5-b868-8804e8ead69e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:39.301026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f0893-6e61-45a5-b868-8804e8ead69e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:39.301026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f0893-6e61-45a5-b868-8804e8ead69e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:39.302393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 665/1342] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:39.308492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2330-4503-46fb-8260-add59206578d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:39.308962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2330-4503-46fb-8260-add59206578d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:39.309084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2330-4503-46fb-8260-add59206578d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:39.384227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-668b2330-4503-46fb-8260-add59206578d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:39.385479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-668b2330-4503-46fb-8260-add59206578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:39.488083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 678/1343] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:39.764952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f0893-6e61-45a5-b868-8804e8ead69e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:39.766606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-374f0893-6e61-45a5-b868-8804e8ead69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:39.877961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f0893-6e61-45a5-b868-8804e8ead69e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:39.961643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:39.962299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:39.962570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:39.962830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:39.964424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:40.011794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:40.081119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:40.082617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1cda-d88e-474c-b29d-ee244d2fb54c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:40.101103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 666/1344] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:43.987562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372880f7-8db5-4d5b-b8ad-0ca53e521482 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:43.988581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372880f7-8db5-4d5b-b8ad-0ca53e521482 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:43.988581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372880f7-8db5-4d5b-b8ad-0ca53e521482 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:43.989899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 679/1345] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:43.995111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04664f55-79dd-4bbf-bc07-d0d518ee5168 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:43.995569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04664f55-79dd-4bbf-bc07-d0d518ee5168 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:43.995679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04664f55-79dd-4bbf-bc07-d0d518ee5168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.069358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-04664f55-79dd-4bbf-bc07-d0d518ee5168 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:44.070622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04664f55-79dd-4bbf-bc07-d0d518ee5168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.169947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:44.172609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 667/1346] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:44.467415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7c133-dd98-4044-9362-1fb62ab50b01 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:44.467658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7c133-dd98-4044-9362-1fb62ab50b01 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:44.467944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7c133-dd98-4044-9362-1fb62ab50b01 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.469492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 680/1347] 10.222.0.75 () {54 vars in 965 bytes} [Wed Aug 31 10:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:44.475469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db0e0-b063-470e-b1b5-f70307799288 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:44.475750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db0e0-b063-470e-b1b5-f70307799288 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:44.476018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db0e0-b063-470e-b1b5-f70307799288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.571483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-610db0e0-b063-470e-b1b5-f70307799288 None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:44.572712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-610db0e0-b063-470e-b1b5-f70307799288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.649579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 668/1348] 10.222.0.75 () {58 vars in 1062 bytes} [Wed Aug 31 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:44.658695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7c133-dd98-4044-9362-1fb62ab50b01 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:44.660253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a7f7c133-dd98-4044-9362-1fb62ab50b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.726083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:44.774687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7c133-dd98-4044-9362-1fb62ab50b01 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:44.850420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:44.851038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:44.851313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:44.851582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.853167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.972975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:44.976859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:44.978594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd98b94-1543-4fb0-aece-c21165b2e98d service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:44.997369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 681/1349] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:50.268342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eee3c-5120-472f-8322-928c316ddbe7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:50.268841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eee3c-5120-472f-8322-928c316ddbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:50.268966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eee3c-5120-472f-8322-928c316ddbe7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:50.270461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 669/1350] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:50.277041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad4c2-96a0-4dc3-a8d3-8d20decf3eb0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:50.278107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad4c2-96a0-4dc3-a8d3-8d20decf3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:50.278552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad4c2-96a0-4dc3-a8d3-8d20decf3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:50.388138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a86ad4c2-96a0-4dc3-a8d3-8d20decf3eb0 None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:50.389701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a86ad4c2-96a0-4dc3-a8d3-8d20decf3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:50.541723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 682/1351] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:54.648100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=59 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:54.704394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d21e4b-fbb4-44a5-8950-fa44ab5b9344 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:54.704683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d21e4b-fbb4-44a5-8950-fa44ab5b9344 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:54.704956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d21e4b-fbb4-44a5-8950-fa44ab5b9344 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:54.706581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 670/1352] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:54.711791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec78cde-6a58-45b8-b5e3-090b9ad7aca9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:54.712560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec78cde-6a58-45b8-b5e3-090b9ad7aca9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:54.713053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec78cde-6a58-45b8-b5e3-090b9ad7aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:54.776014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:54.803635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7ec78cde-6a58-45b8-b5e3-090b9ad7aca9 None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:54.805183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7ec78cde-6a58-45b8-b5e3-090b9ad7aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:54.935624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 683/1353] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:56.312529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f90b-a0ab-48ae-9243-f8c32a140371 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:56.313440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f90b-a0ab-48ae-9243-f8c32a140371 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:56.313719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f90b-a0ab-48ae-9243-f8c32a140371 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:56.315178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 671/1354] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:56.320591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e69cc-d0ba-4938-b06d-5bf07e433b2d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:56.321030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e69cc-d0ba-4938-b06d-5bf07e433b2d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:56.321282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e69cc-d0ba-4938-b06d-5bf07e433b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:56.403731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cb1e69cc-d0ba-4938-b06d-5bf07e433b2d None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:56.405003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cb1e69cc-d0ba-4938-b06d-5bf07e433b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:56.452193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:56.520953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 684/1355] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:59.854795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3f69-e09d-4b42-b0d5-a38f7c993b3b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:59.855274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3f69-e09d-4b42-b0d5-a38f7c993b3b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:59.855389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3f69-e09d-4b42-b0d5-a38f7c993b3b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:59.856716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 672/1356] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:59.862164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60c817-0939-48a7-9764-c2acdceed247 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:59.862606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60c817-0939-48a7-9764-c2acdceed247 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:59.862716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60c817-0939-48a7-9764-c2acdceed247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:59.943562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ab60c817-0939-48a7-9764-c2acdceed247 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:59.944960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ab60c817-0939-48a7-9764-c2acdceed247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:00.077919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 685/1357] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:00.369367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398da66f-c2f5-43a5-b074-6fe728d0da48 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:00.369716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398da66f-c2f5-43a5-b074-6fe728d0da48 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:00.369980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398da66f-c2f5-43a5-b074-6fe728d0da48 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:00.371777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 673/1358] 10.222.0.75 () {54 vars in 962 bytes} [Wed Aug 31 10:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:00.378209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9c74-535f-4ef6-be89-e7700d4d0a0b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:00.378539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9c74-535f-4ef6-be89-e7700d4d0a0b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:00.378882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9c74-535f-4ef6-be89-e7700d4d0a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:00.397644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:00.467652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-58ec9c74-535f-4ef6-be89-e7700d4d0a0b None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:00.469107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-58ec9c74-535f-4ef6-be89-e7700d4d0a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:00.600373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 686/1359] 10.222.0.75 () {58 vars in 1059 bytes} [Wed Aug 31 10:47:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:00.608403 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398da66f-c2f5-43a5-b074-6fe728d0da48 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:00.609975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-398da66f-c2f5-43a5-b074-6fe728d0da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:00.772326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398da66f-c2f5-43a5-b074-6fe728d0da48 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:00.873461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:00.915506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:00.916140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:00.916476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:00.916752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:00.918490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:01.011745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:01.014092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ecd9-2654-42fc-9f82-fcdb6ec9589d service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:01.036084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 674/1360] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:03.128724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c797d7-024a-475d-9a9e-ed1c1a451b7a None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:03.129278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c797d7-024a-475d-9a9e-ed1c1a451b7a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:03.129278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c797d7-024a-475d-9a9e-ed1c1a451b7a None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:03.130808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 687/1361] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:03.136051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fddc69-690c-46ca-944c-015a743ec513 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:03.136500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fddc69-690c-46ca-944c-015a743ec513 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:03.136582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fddc69-690c-46ca-944c-015a743ec513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:03.207066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-74fddc69-690c-46ca-944c-015a743ec513 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:03.208312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-74fddc69-690c-46ca-944c-015a743ec513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:03.247186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:03.312754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 675/1362] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:03.600205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c797d7-024a-475d-9a9e-ed1c1a451b7a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:03.601918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a3c797d7-024a-475d-9a9e-ed1c1a451b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:03.675900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:03.773192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c797d7-024a-475d-9a9e-ed1c1a451b7a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:03.903687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:03.904489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:03.904917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:03.905275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:03.907033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:03.931944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.010808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:04.013342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149eb48-ac94-41a9-b345-89eb3cc00585 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:04.033458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 688/1363] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:06.261616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4344d-1cb8-42f6-a1e9-f43ae112c29d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:06.262268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4344d-1cb8-42f6-a1e9-f43ae112c29d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:06.262268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4344d-1cb8-42f6-a1e9-f43ae112c29d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:06.263623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 676/1364] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:06.269187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf09a-81b5-409c-ad61-47f8acca5fbf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:06.269667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf09a-81b5-409c-ad61-47f8acca5fbf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:06.269984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf09a-81b5-409c-ad61-47f8acca5fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:06.344625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8badf09a-81b5-409c-ad61-47f8acca5fbf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:06.346292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8badf09a-81b5-409c-ad61-47f8acca5fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:06.451523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:06.457871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 689/1365] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:06.743220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756bc4-700d-4ad9-be96-b248b82a249d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:06.743583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756bc4-700d-4ad9-be96-b248b82a249d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:06.743798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756bc4-700d-4ad9-be96-b248b82a249d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:06.745431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 677/1366] 10.222.0.75 () {54 vars in 962 bytes} [Wed Aug 31 10:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:47:06.758729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e09a6-259e-47a4-be2f-22ed895a9e7e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:06.759733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e09a6-259e-47a4-be2f-22ed895a9e7e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:06.760008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e09a6-259e-47a4-be2f-22ed895a9e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:06.849976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5a6e09a6-259e-47a4-be2f-22ed895a9e7e None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:06.851300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5a6e09a6-259e-47a4-be2f-22ed895a9e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:06.974284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 690/1367] 10.222.0.75 () {58 vars in 1059 bytes} [Wed Aug 31 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:06.982287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756bc4-700d-4ad9-be96-b248b82a249d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:06.983773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3756bc4-700d-4ad9-be96-b248b82a249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:07.142605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756bc4-700d-4ad9-be96-b248b82a249d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:07.166211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:07.264077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:07.264747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:07.264987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:07.265192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:07.266736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:07.358598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:07.360192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c49762-7d33-47c7-93eb-c6307a39e91f service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:07.381669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 678/1368] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:07.983753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e6ce-ff41-4578-a008-a70ad2263d44 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:07.984300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e6ce-ff41-4578-a008-a70ad2263d44 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:07.984300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e6ce-ff41-4578-a008-a70ad2263d44 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:07.985886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 691/1369] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:47:07.991107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75033-1e64-423b-808a-d4bd546b8f76 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:07.991419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75033-1e64-423b-808a-d4bd546b8f76 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:07.991626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75033-1e64-423b-808a-d4bd546b8f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:08.024447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:08.061382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b8c75033-1e64-423b-808a-d4bd546b8f76 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:08.062669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b8c75033-1e64-423b-808a-d4bd546b8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:08.169866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 679/1370] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:08.762352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e915-e16a-4a36-94a7-a20bbf5db113 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:08.762712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e915-e16a-4a36-94a7-a20bbf5db113 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:08.763041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e915-e16a-4a36-94a7-a20bbf5db113 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:08.764790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 692/1371] 10.222.0.75 () {54 vars in 964 bytes} [Wed Aug 31 10:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:08.770018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be4ec-a142-4e3d-9123-321e06c06de6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:08.770508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be4ec-a142-4e3d-9123-321e06c06de6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:08.770508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be4ec-a142-4e3d-9123-321e06c06de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:08.860116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f94be4ec-a142-4e3d-9123-321e06c06de6 None None] MFA Rules not processed for user `b52dcd18d699460b8a4d298a381a35d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:08.861344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f94be4ec-a142-4e3d-9123-321e06c06de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:08.912324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:08.944458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 680/1372] 10.222.0.75 () {58 vars in 1061 bytes} [Wed Aug 31 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:08.952412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845e915-e16a-4a36-94a7-a20bbf5db113 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:08.953956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d845e915-e16a-4a36-94a7-a20bbf5db113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:09.007860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:09.061813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845e915-e16a-4a36-94a7-a20bbf5db113 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:09.146888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:09.147541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.147806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.148067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.149656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:09.267350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:09.283767 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:09.285334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671c09f-4774-457e-b9bf-67d8b630526e service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:09.313997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 693/1373] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:09.380437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413d74-2efb-4108-a527-d304d4624984 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.380774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413d74-2efb-4108-a527-d304d4624984 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.381240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413d74-2efb-4108-a527-d304d4624984 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.386090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 681/1374] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:09.387734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b4d6-4b1c-4949-97d4-af583f079063 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.387894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b4d6-4b1c-4949-97d4-af583f079063 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.388461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b4d6-4b1c-4949-97d4-af583f079063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.464512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f6d0b4d6-4b1c-4949-97d4-af583f079063 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:09.465857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f6d0b4d6-4b1c-4949-97d4-af583f079063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:09.568205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 694/1375] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:09.857568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413d74-2efb-4108-a527-d304d4624984 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:09.859253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-36413d74-2efb-4108-a527-d304d4624984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:10.012311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413d74-2efb-4108-a527-d304d4624984 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:10.072667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:10.137516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:10.138082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:10.138338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:10.138624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:10.140282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:10.232084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:10.233720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e77005-c521-4899-a37e-517bf1a25269 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:10.251598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 682/1376] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:12.181659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b091aa-3705-4e8e-bd7c-7729803e61e8 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:12.182255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b091aa-3705-4e8e-bd7c-7729803e61e8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:12.182255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b091aa-3705-4e8e-bd7c-7729803e61e8 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:12.183618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 695/1377] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:12.188891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905234d6-cdeb-49a2-9f8c-34823fcb7112 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:12.189419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905234d6-cdeb-49a2-9f8c-34823fcb7112 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:12.189562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905234d6-cdeb-49a2-9f8c-34823fcb7112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:12.264112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-905234d6-cdeb-49a2-9f8c-34823fcb7112 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:12.265915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-905234d6-cdeb-49a2-9f8c-34823fcb7112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:12.273065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:12.396094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 683/1378] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:12.681807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b091aa-3705-4e8e-bd7c-7729803e61e8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:12.685063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-25b091aa-3705-4e8e-bd7c-7729803e61e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:12.759302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:12.914697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b091aa-3705-4e8e-bd7c-7729803e61e8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:13.034720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:13.035269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:13.035532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:13.035800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:13.037398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:13.056926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:13.133136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:13.134778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bbd66-ef3a-4af9-ab3a-87bedd37b17c service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:13.153569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 696/1379] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:15.111478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e95ffb-9753-4d82-8798-e0a8e40ffbe0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:15.112041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e95ffb-9753-4d82-8798-e0a8e40ffbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:15.112041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e95ffb-9753-4d82-8798-e0a8e40ffbe0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:15.113431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 684/1380] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:15.118883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178179dd-cdab-4dde-ae85-d21b0d379043 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:15.119363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178179dd-cdab-4dde-ae85-d21b0d379043 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:15.119363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178179dd-cdab-4dde-ae85-d21b0d379043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:15.203567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-178179dd-cdab-4dde-ae85-d21b0d379043 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:15.205036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-178179dd-cdab-4dde-ae85-d21b0d379043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:15.311828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:15.324410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 697/1381] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:15.604701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e95ffb-9753-4d82-8798-e0a8e40ffbe0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:15.606334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00e95ffb-9753-4d82-8798-e0a8e40ffbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:15.753366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:15.766437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e95ffb-9753-4d82-8798-e0a8e40ffbe0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:15.906185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:15.906805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:15.907078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:15.907344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:15.908928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:16.003057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:16.004666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a005063-4f0e-41aa-8bca-99edb1ecd4bc service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:16.015804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:16.025078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 685/1382] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:18.087207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa21b7-2f7b-43e6-b5b8-612d3d81ff1c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:18.087814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa21b7-2f7b-43e6-b5b8-612d3d81ff1c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:18.087814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa21b7-2f7b-43e6-b5b8-612d3d81ff1c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:18.089247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 698/1383] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:18.094842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db367-d824-4691-89a9-8bdc634d7d90 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:18.095410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db367-d824-4691-89a9-8bdc634d7d90 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:18.095410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db367-d824-4691-89a9-8bdc634d7d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:18.165567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-335db367-d824-4691-89a9-8bdc634d7d90 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:18.166870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-335db367-d824-4691-89a9-8bdc634d7d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:18.285874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 686/1384] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:18.576241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa21b7-2f7b-43e6-b5b8-612d3d81ff1c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:18.577877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0dfa21b7-2f7b-43e6-b5b8-612d3d81ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:18.732862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa21b7-2f7b-43e6-b5b8-612d3d81ff1c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:18.804225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:18.853002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:18.853571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:18.853895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:18.854166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:18.855783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:18.952262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:18.954004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e270674-c632-4687-ab71-4c13193fdde4 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:18.973120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 699/1385] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:20.874621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03818-02a4-47ea-8859-f5ed7152c9d1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:20.875358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03818-02a4-47ea-8859-f5ed7152c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:20.875358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b03818-02a4-47ea-8859-f5ed7152c9d1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:20.876558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 687/1386] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:20.882030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a005dc-9a60-4975-b357-c07c7fe5ed06 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:20.882511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a005dc-9a60-4975-b357-c07c7fe5ed06 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:20.882652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a005dc-9a60-4975-b357-c07c7fe5ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:20.979877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-92a005dc-9a60-4975-b357-c07c7fe5ed06 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:20.981311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-92a005dc-9a60-4975-b357-c07c7fe5ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:21.019630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:21.102638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 700/1387] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:47:21.422065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03818-02a4-47ea-8859-f5ed7152c9d1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:21.423689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-43b03818-02a4-47ea-8859-f5ed7152c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:21.510983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:21.596822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b03818-02a4-47ea-8859-f5ed7152c9d1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:21.725284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:21.725935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:21.726210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:21.726475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:21.728111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:21.770376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:21.834160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:21.836220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91dbd2-2913-407e-8073-a90402b2943a service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:21.860716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 688/1388] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:23.887406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402691fb-8bcd-4069-ac7e-6c58d3e423d6 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:23.887972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402691fb-8bcd-4069-ac7e-6c58d3e423d6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:23.887972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402691fb-8bcd-4069-ac7e-6c58d3e423d6 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:23.889361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 701/1389] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:23.894821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0620bb-c9df-4895-b703-19cae8da3a5c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:23.895287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0620bb-c9df-4895-b703-19cae8da3a5c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:23.895450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0620bb-c9df-4895-b703-19cae8da3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:23.964228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ee0620bb-c9df-4895-b703-19cae8da3a5c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:23.965431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee0620bb-c9df-4895-b703-19cae8da3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:24.065000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 689/1390] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:24.354803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402691fb-8bcd-4069-ac7e-6c58d3e423d6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:24.356419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-402691fb-8bcd-4069-ac7e-6c58d3e423d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:24.492815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a5ff-0e6e-4710-b21a-d68d175a6a4d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:24.493148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a5ff-0e6e-4710-b21a-d68d175a6a4d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:24.493587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a5ff-0e6e-4710-b21a-d68d175a6a4d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:24.495083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 690/1391] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:24.500207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d98b-92cb-4fcd-8dc7-e18f55563de0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:24.500480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d98b-92cb-4fcd-8dc7-e18f55563de0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:24.500750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d98b-92cb-4fcd-8dc7-e18f55563de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:24.509239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402691fb-8bcd-4069-ac7e-6c58d3e423d6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:24.517893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:24.527445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:24.572516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b7f8d98b-92cb-4fcd-8dc7-e18f55563de0 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:24.573798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b7f8d98b-92cb-4fcd-8dc7-e18f55563de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:24.628885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:24.629405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:24.629692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:24.629986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:24.631585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:24.677281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 691/1392] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:24.723990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:24.725601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574fd18-6a8d-4cde-88dd-39d401f42603 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:24.744169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 702/1393] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:24.978952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154de4d-a5e3-4519-872d-5069c3a0d93d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:24.979443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154de4d-a5e3-4519-872d-5069c3a0d93d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:24.979552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154de4d-a5e3-4519-872d-5069c3a0d93d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:24.981013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 692/1394] 10.222.0.75 () {54 vars in 967 bytes} [Wed Aug 31 10:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:24.986309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476c285-3ace-42a8-a9ff-b5e104ee431b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:24.986715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476c285-3ace-42a8-a9ff-b5e104ee431b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:24.986892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476c285-3ace-42a8-a9ff-b5e104ee431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:25.013700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:25.066733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9476c285-3ace-42a8-a9ff-b5e104ee431b None None] MFA Rules not processed for user `7c86b5bf0b10480e88d5cc2d51ef1cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:25.068021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9476c285-3ace-42a8-a9ff-b5e104ee431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:25.145107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 703/1395] 10.222.0.75 () {58 vars in 1064 bytes} [Wed Aug 31 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:25.152871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154de4d-a5e3-4519-872d-5069c3a0d93d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:25.154390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7154de4d-a5e3-4519-872d-5069c3a0d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:25.253628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:25.261097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154de4d-a5e3-4519-872d-5069c3a0d93d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:25.337794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:25.338409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:25.338683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:25.338951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:25.340532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:25.472657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:25.474164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfbfe5-eb24-472f-8fc4-8156e298187a service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:25.491993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 693/1396] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:26.243162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08ff07-6c4c-4fe2-b909-6264cad2219a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:26.243708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08ff07-6c4c-4fe2-b909-6264cad2219a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:26.243708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08ff07-6c4c-4fe2-b909-6264cad2219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:26.314235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-eb08ff07-6c4c-4fe2-b909-6264cad2219a None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:26.315481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eb08ff07-6c4c-4fe2-b909-6264cad2219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:26.379095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:26.410842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 704/1397] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:26.454752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3469907-2b33-459e-bb52-05a17d19c9fd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:26.455305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3469907-2b33-459e-bb52-05a17d19c9fd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:26.455305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3469907-2b33-459e-bb52-05a17d19c9fd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:26.456654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 694/1398] 10.222.0.75 () {54 vars in 943 bytes} [Wed Aug 31 10:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:26.463547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ad32-f2ff-48dc-a24d-ed069abb4268 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:26.463828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ad32-f2ff-48dc-a24d-ed069abb4268 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:26.464104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854ad32-f2ff-48dc-a24d-ed069abb4268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:26.543938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4854ad32-f2ff-48dc-a24d-ed069abb4268 None None] MFA Rules not processed for user `33b930c3607b42a5801da45336c9c009`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:26.545193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4854ad32-f2ff-48dc-a24d-ed069abb4268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:26.654514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 705/1399] 10.222.0.75 () {58 vars in 1040 bytes} [Wed Aug 31 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:26.668826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3469907-2b33-459e-bb52-05a17d19c9fd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:26.670374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3469907-2b33-459e-bb52-05a17d19c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:26.676194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6c0e0-37e7-4bdb-a9ee-9bc6abb73173 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:26.676480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6c0e0-37e7-4bdb-a9ee-9bc6abb73173 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:26.676755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6c0e0-37e7-4bdb-a9ee-9bc6abb73173 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:26.678179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 706/1400] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:26.683466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:26.683753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:26.684069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:26.695118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:26.729926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:26.751751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:26.752971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:26.822652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3469907-2b33-459e-bb52-05a17d19c9fd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:26.870779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 707/1401] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:26.956329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:26.956959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:26.958008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:26.958947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:26.960456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:26.969008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:27.069864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:27.071490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93651e6-3ae5-45ed-b7b6-4fbe3d64192f service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:27.080260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 695/1402] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:47:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:47:27.157259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:27.158552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:27.282077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d0be3-79ef-4fe9-ab05-d8af2cf49305 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:27.285580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:27.410573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:27.411417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:27.411762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:27.412119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:27.413877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:27.513274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:27.514931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9511548-4019-4540-9f4f-ae99d89649d6 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:27.535945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 708/1403] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:29.495649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aafd7-aba9-4fa4-a7ec-965e162badf3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:29.496428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aafd7-aba9-4fa4-a7ec-965e162badf3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:29.496428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aafd7-aba9-4fa4-a7ec-965e162badf3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:29.499488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 696/1404] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:29.505068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4169f-085f-4242-8ff4-56a88d03699d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:29.505605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4169f-085f-4242-8ff4-56a88d03699d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:29.505605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4169f-085f-4242-8ff4-56a88d03699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:29.517754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:29.584217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9dd4169f-085f-4242-8ff4-56a88d03699d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:29.585552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9dd4169f-085f-4242-8ff4-56a88d03699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:29.701839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 709/1405] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:29.993515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aafd7-aba9-4fa4-a7ec-965e162badf3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:29.996405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f46aafd7-aba9-4fa4-a7ec-965e162badf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:30.162879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aafd7-aba9-4fa4-a7ec-965e162badf3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:30.166470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:30.284077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:30.284686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:30.284958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:30.285229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:30.286862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:30.382272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:30.384547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06683-d662-44e0-9013-c4b25636bf43 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:30.406756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 697/1406] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:32.386862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63696791-3df8-4e1e-85a6-c0d253ff25f1 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:32.387438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63696791-3df8-4e1e-85a6-c0d253ff25f1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:32.387438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63696791-3df8-4e1e-85a6-c0d253ff25f1 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:32.389056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 710/1407] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:32.394581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6883b6-6721-4be9-95b7-63bfff864da0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:32.396095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6883b6-6721-4be9-95b7-63bfff864da0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:32.396423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6883b6-6721-4be9-95b7-63bfff864da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:32.411844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:32.479279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7f6883b6-6721-4be9-95b7-63bfff864da0 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:32.481035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f6883b6-6721-4be9-95b7-63bfff864da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:32.593065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 698/1408] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:32.880395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63696791-3df8-4e1e-85a6-c0d253ff25f1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:32.881970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-63696791-3df8-4e1e-85a6-c0d253ff25f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:32.973661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:33.037581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63696791-3df8-4e1e-85a6-c0d253ff25f1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:33.176748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:33.177388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:33.177666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:33.178017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:33.179708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:33.234484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:33.281464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:33.281464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a655c3c-10c4-4a4e-9d12-9999bb2837d2 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:33.300672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 711/1409] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:42.590527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=62 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:43.297950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=23 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:49.017974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f45f40-818d-4cd8-8c36-919c89923f7e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:49.018606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f45f40-818d-4cd8-8c36-919c89923f7e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:49.018606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f45f40-818d-4cd8-8c36-919c89923f7e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:49.020366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 699/1410] 10.222.0.75 () {54 vars in 918 bytes} [Wed Aug 31 10:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:49.025799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c26fa-9ad0-47a5-96a0-7ffb733d751b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:49.026257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c26fa-9ad0-47a5-96a0-7ffb733d751b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:49.026360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c26fa-9ad0-47a5-96a0-7ffb733d751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:49.108227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b99c26fa-9ad0-47a5-96a0-7ffb733d751b None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:49.109485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b99c26fa-9ad0-47a5-96a0-7ffb733d751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:49.226714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 712/1411] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Aug 31 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:49.248183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4fc44-f566-45b1-a53c-c05b808ab472 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:49.248458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4fc44-f566-45b1-a53c-c05b808ab472 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:49.248721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4fc44-f566-45b1-a53c-c05b808ab472 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:49.250209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 700/1412] 10.222.0.75 () {54 vars in 918 bytes} [Wed Aug 31 10:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:49.255127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea987-727c-41f2-b0f0-92b57e5376ad None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:49.255412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea987-727c-41f2-b0f0-92b57e5376ad None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:49.255679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea987-727c-41f2-b0f0-92b57e5376ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:49.334957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:49.338650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-714ea987-727c-41f2-b0f0-92b57e5376ad None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:49.340419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-714ea987-727c-41f2-b0f0-92b57e5376ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:49.474231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 713/1413] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Aug 31 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:51.865746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91478642-8677-4613-89e0-bd83d7f56460 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:51.866320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91478642-8677-4613-89e0-bd83d7f56460 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:51.866421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91478642-8677-4613-89e0-bd83d7f56460 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:51.868458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:51.876408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17817364-333d-4d21-95b5-80e2675421d5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:51.876809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17817364-333d-4d21-95b5-80e2675421d5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:51.876950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17817364-333d-4d21-95b5-80e2675421d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:51.948482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-17817364-333d-4d21-95b5-80e2675421d5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:51.949708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-17817364-333d-4d21-95b5-80e2675421d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:52.005255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:52.051880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:52.346638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91478642-8677-4613-89e0-bd83d7f56460 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:52.348247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-91478642-8677-4613-89e0-bd83d7f56460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:52.502897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91478642-8677-4613-89e0-bd83d7f56460 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:52.587431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:52.642386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:52.642994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:52.643270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:52.643536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:52.645143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:52.748381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:52.749995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebe352-7ab0-4bd8-8a56-b900abbd45e3 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:52.768386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 702/1416] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:53.673467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdb9bb-19ac-4599-aed7-f831d6295546 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:53.674495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdb9bb-19ac-4599-aed7-f831d6295546 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:53.674495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdb9bb-19ac-4599-aed7-f831d6295546 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:53.676616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:47:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:53.684887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b941d68-d4d9-4702-8096-5afa715d76e5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:53.685647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b941d68-d4d9-4702-8096-5afa715d76e5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:53.685831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b941d68-d4d9-4702-8096-5afa715d76e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:53.771049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5b941d68-d4d9-4702-8096-5afa715d76e5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:53.772260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5b941d68-d4d9-4702-8096-5afa715d76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:53.801192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:53.878579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:54.029726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdb9bb-19ac-4599-aed7-f831d6295546 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:54.031337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-80fdb9bb-19ac-4599-aed7-f831d6295546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:54.197189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdb9bb-19ac-4599-aed7-f831d6295546 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:54.245945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:54.323361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:54.323981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:54.324286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:54.324555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:54.326613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:54.427878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:54.429559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea88f-3b78-4f8e-9b72-fc6e81ec5ae0 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:54.448162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 716/1419] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:55.360511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9c46-d963-4cd2-996b-853ecfe1a2f2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:55.361092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9c46-d963-4cd2-996b-853ecfe1a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:55.361092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9c46-d963-4cd2-996b-853ecfe1a2f2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:55.363118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:47:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:55.372096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef99ec-71f9-4137-8ef5-c6933cb1f1af None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:55.372621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef99ec-71f9-4137-8ef5-c6933cb1f1af None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:55.373303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef99ec-71f9-4137-8ef5-c6933cb1f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:55.439585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:55.466681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-34ef99ec-71f9-4137-8ef5-c6933cb1f1af None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:55.468398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-34ef99ec-71f9-4137-8ef5-c6933cb1f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:55.569002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:55.725296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e9c46-d963-4cd2-996b-853ecfe1a2f2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:55.727952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e91e9c46-d963-4cd2-996b-853ecfe1a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:55.887351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e9c46-d963-4cd2-996b-853ecfe1a2f2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:55.900521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:56.007908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:56.008430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:56.008698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:56.008961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:56.010633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:56.104032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:56.105659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25703aec-30a3-476f-b38d-258cbb11877e service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:56.124315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 705/1422] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:56.987331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4c0e-3e2f-4c3e-a073-35e486e19cab None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:56.988264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4c0e-3e2f-4c3e-a073-35e486e19cab None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:56.988421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4c0e-3e2f-4c3e-a073-35e486e19cab None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:56.990712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:47:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:56.999293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433baf54-ef11-42bb-af23-49c5a86dc3e6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:56.999725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433baf54-ef11-42bb-af23-49c5a86dc3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:56.999921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433baf54-ef11-42bb-af23-49c5a86dc3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:57.021585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:57.085937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-433baf54-ef11-42bb-af23-49c5a86dc3e6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:57.087146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-433baf54-ef11-42bb-af23-49c5a86dc3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:57.192059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:57.355631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4c0e-3e2f-4c3e-a073-35e486e19cab None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:57.363659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3bbb4c0e-3e2f-4c3e-a073-35e486e19cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:57.505676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:57.543025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4c0e-3e2f-4c3e-a073-35e486e19cab None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:57.671689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:57.672314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:57.672590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:57.672860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:57.674512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:57.765471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:57.783476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:57.785178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dc8c7-18f1-4e7e-9099-2f12d7cccc71 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:57.805896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 719/1425] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:58.679834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2be65-ff96-4fb1-bb0e-a09a05cc914e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:58.680405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2be65-ff96-4fb1-bb0e-a09a05cc914e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:58.680405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2be65-ff96-4fb1-bb0e-a09a05cc914e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:58.681735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:47:58.687836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5162-a4a5-4652-8967-da31c94b8340 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:58.688537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5162-a4a5-4652-8967-da31c94b8340 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:58.688701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5162-a4a5-4652-8967-da31c94b8340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:58.769016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-617f5162-a4a5-4652-8967-da31c94b8340 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:58.770270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-617f5162-a4a5-4652-8967-da31c94b8340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:58.875851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:59.028383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2be65-ff96-4fb1-bb0e-a09a05cc914e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:59.030659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3e2be65-ff96-4fb1-bb0e-a09a05cc914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:59.129531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:59.194349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2be65-ff96-4fb1-bb0e-a09a05cc914e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:59.319327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:59.319863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:59.320141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:59.320405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:59.322070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:59.375844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:59.424392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:59.426275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362417d2-662d-4f6f-9c5c-28467935344f service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:59.444428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 708/1428] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:00.253234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78905a-692a-41df-9cc5-837408688b79 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:00.254278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78905a-692a-41df-9cc5-837408688b79 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:00.254278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78905a-692a-41df-9cc5-837408688b79 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:00.256379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:00.262554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e92ab-76d1-4d4b-b196-5fc9219f22ec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:00.263252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e92ab-76d1-4d4b-b196-5fc9219f22ec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:00.263452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e92ab-76d1-4d4b-b196-5fc9219f22ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:00.342594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-472e92ab-76d1-4d4b-b196-5fc9219f22ec None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:00.343815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-472e92ab-76d1-4d4b-b196-5fc9219f22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:00.442421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:00.599910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78905a-692a-41df-9cc5-837408688b79 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:00.602199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b78905a-692a-41df-9cc5-837408688b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:00.664951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:00.766976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78905a-692a-41df-9cc5-837408688b79 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:00.883916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:00.884468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:00.884720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:00.884985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:00.886595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:00.893957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:00.983328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:00.984957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2d221-3c05-45dc-be0c-2fed1dd68469 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:01.003137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 722/1431] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:01.803366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2f77-d929-4e9a-a000-46673f1c5b9e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:01.804302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2f77-d929-4e9a-a000-46673f1c5b9e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:01.804302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2f77-d929-4e9a-a000-46673f1c5b9e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:01.806412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:48:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:01.814587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fab47-8f72-434f-b687-f31ed55f481a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:01.815060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fab47-8f72-434f-b687-f31ed55f481a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:01.815168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fab47-8f72-434f-b687-f31ed55f481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:01.898120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-234fab47-8f72-434f-b687-f31ed55f481a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:01.899334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-234fab47-8f72-434f-b687-f31ed55f481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:01.973042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:02.002280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:02.152040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2f77-d929-4e9a-a000-46673f1c5b9e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:02.154265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9dcc2f77-d929-4e9a-a000-46673f1c5b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:02.172499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:02.309615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2f77-d929-4e9a-a000-46673f1c5b9e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:02.409682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:02.436963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:02.437571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:02.437881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:02.438148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:02.439783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:02.538815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:02.540410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00420edf-b234-4943-8a53-762fef4ff75a service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:02.567549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 711/1434] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:03.378195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ba837-e3e9-4ef1-ba1b-b07c5140c55c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:03.379103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ba837-e3e9-4ef1-ba1b-b07c5140c55c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:03.379103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ba837-e3e9-4ef1-ba1b-b07c5140c55c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:03.381318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:48:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:03.388575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9e18-829f-40b0-8080-bcdb24b2efad None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:03.389146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9e18-829f-40b0-8080-bcdb24b2efad None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:03.389146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9e18-829f-40b0-8080-bcdb24b2efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:03.474733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a01d9e18-829f-40b0-8080-bcdb24b2efad None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:03.475868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a01d9e18-829f-40b0-8080-bcdb24b2efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:03.518632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:03.576036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:48:03.730837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ba837-e3e9-4ef1-ba1b-b07c5140c55c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:03.733040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e74ba837-e3e9-4ef1-ba1b-b07c5140c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:03.899429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ba837-e3e9-4ef1-ba1b-b07c5140c55c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:03.960716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:04.025846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:04.026401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:04.026676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:04.026946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:04.028563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:04.131141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:04.133724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82087e5-2be1-4a9d-9396-0b86e80d9c49 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:04.155065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 725/1437] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:04.959728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44add756-06d5-4cae-ba11-714e619cefff None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:04.960640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44add756-06d5-4cae-ba11-714e619cefff None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:04.960640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44add756-06d5-4cae-ba11-714e619cefff None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:04.962873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:04.968240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9284d-626b-4189-81b1-c6ae6dc4117f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:04.968698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9284d-626b-4189-81b1-c6ae6dc4117f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:04.968795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9284d-626b-4189-81b1-c6ae6dc4117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:05.046142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b7f9284d-626b-4189-81b1-c6ae6dc4117f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:05.047408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b7f9284d-626b-4189-81b1-c6ae6dc4117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:05.049525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:05.148722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:48:05.300709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44add756-06d5-4cae-ba11-714e619cefff None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:05.303109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-44add756-06d5-4cae-ba11-714e619cefff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:05.487488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44add756-06d5-4cae-ba11-714e619cefff None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:05.516499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:05.613079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:05.613692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:05.614011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:05.614286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:05.615945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:05.718928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:05.720553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272e24c-aff9-4fec-9875-d5afb308bce1 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:05.742279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 714/1440] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:07.549044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746e51-08be-4baa-bcba-61bea573c588 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:07.549512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746e51-08be-4baa-bcba-61bea573c588 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:07.549624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746e51-08be-4baa-bcba-61bea573c588 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:07.551030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:07.557428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16dbe6-d252-4be8-b522-ecd3c907bcba None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:07.557902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16dbe6-d252-4be8-b522-ecd3c907bcba None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:07.558004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16dbe6-d252-4be8-b522-ecd3c907bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:07.609871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:07.638072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4a16dbe6-d252-4be8-b522-ecd3c907bcba None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:07.639334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4a16dbe6-d252-4be8-b522-ecd3c907bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:07.740200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:08.025375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746e51-08be-4baa-bcba-61bea573c588 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:08.027959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c9746e51-08be-4baa-bcba-61bea573c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:08.138646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746e51-08be-4baa-bcba-61bea573c588 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:08.170754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:08.213428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:08.214086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:08.214347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:08.214607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:08.216218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:08.332230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:08.333711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc99c9-c0a0-4e89-8ab8-bad7d067907b service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:08.354759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 728/1443] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:10.454292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2202da-e5f6-4925-bb29-ea3213b1adf7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:10.454819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2202da-e5f6-4925-bb29-ea3213b1adf7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:10.454819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2202da-e5f6-4925-bb29-ea3213b1adf7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:10.456526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:10.463260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59ead-d901-476e-b19c-561d82c2f6af None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:10.464026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59ead-d901-476e-b19c-561d82c2f6af None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:10.464235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59ead-d901-476e-b19c-561d82c2f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:10.537914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-45a59ead-d901-476e-b19c-561d82c2f6af None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:10.539163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-45a59ead-d901-476e-b19c-561d82c2f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:10.552971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:10.643632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:10.939003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2202da-e5f6-4925-bb29-ea3213b1adf7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:10.940564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ab2202da-e5f6-4925-bb29-ea3213b1adf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:11.060229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2202da-e5f6-4925-bb29-ea3213b1adf7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:11.075777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:11.146891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:11.147415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:11.147686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:11.147958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:11.149523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:11.265190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:11.266647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8262d9-e11e-4f68-a1d2-4f1360a63d13 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:11.286606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 717/1446] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:13.598738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd6dea-3d0e-4346-93f8-d3f3d12ab973 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:13.599292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd6dea-3d0e-4346-93f8-d3f3d12ab973 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:13.599292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd6dea-3d0e-4346-93f8-d3f3d12ab973 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:13.600655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:13.607168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9bbd5-327d-4afa-934f-7f37f60be0c7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:13.607628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9bbd5-327d-4afa-934f-7f37f60be0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:13.607724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9bbd5-327d-4afa-934f-7f37f60be0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:13.659190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:13.678312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-84d9bbd5-327d-4afa-934f-7f37f60be0c7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:13.679547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84d9bbd5-327d-4afa-934f-7f37f60be0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:13.784431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:14.074097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd6dea-3d0e-4346-93f8-d3f3d12ab973 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:14.076530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fedd6dea-3d0e-4346-93f8-d3f3d12ab973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:14.204144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd6dea-3d0e-4346-93f8-d3f3d12ab973 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:14.246124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:14.286241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:14.286856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:14.287137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:14.287406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:14.289008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:14.400809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:14.402325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97153c-c975-41b1-bc81-d6d311204628 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:14.420794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 731/1449] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:16.460510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5317-9a27-41e8-8bdc-4193ad41b2d3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:16.461115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5317-9a27-41e8-8bdc-4193ad41b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:16.461115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5317-9a27-41e8-8bdc-4193ad41b2d3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:16.462454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:16.468179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0bd53-9347-4619-be93-4e32c0829a3b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:16.468650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0bd53-9347-4619-be93-4e32c0829a3b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:16.468754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0bd53-9347-4619-be93-4e32c0829a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:16.539762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a0d0bd53-9347-4619-be93-4e32c0829a3b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:16.540943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0d0bd53-9347-4619-be93-4e32c0829a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:16.562236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:16.645267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:16.940409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5317-9a27-41e8-8bdc-4193ad41b2d3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:16.941973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-39af5317-9a27-41e8-8bdc-4193ad41b2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:17.051858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5317-9a27-41e8-8bdc-4193ad41b2d3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:17.074380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:17.141867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:17.142234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:17.142506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:17.142770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:17.144395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:17.267568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:17.269011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615f46c-4987-4a9b-8842-ee35ceed561c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:17.288529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 720/1452] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:48:19.258879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715a39-e775-49ac-9ae3-f75e9f7833ba None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:19.259845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715a39-e775-49ac-9ae3-f75e9f7833ba None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:19.259845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715a39-e775-49ac-9ae3-f75e9f7833ba None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:19.262221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:19.270331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c4e39-3cb0-491f-a275-3f36fef5d3a5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:19.270755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c4e39-3cb0-491f-a275-3f36fef5d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:19.270847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c4e39-3cb0-491f-a275-3f36fef5d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:19.337821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:19.341217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1f4c4e39-3cb0-491f-a275-3f36fef5d3a5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:19.343234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1f4c4e39-3cb0-491f-a275-3f36fef5d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:19.448716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:48:19.732281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715a39-e775-49ac-9ae3-f75e9f7833ba None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:19.733816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6715a39-e775-49ac-9ae3-f75e9f7833ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:19.842802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715a39-e775-49ac-9ae3-f75e9f7833ba None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:19.891587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:19.918166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:19.918785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:19.919060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:19.919328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:19.920955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:20.049804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:20.051256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175a2a4-68b9-4933-92c4-eab2530c9556 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:20.069475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 734/1455] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:22.103132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3633c-37e3-4724-ab45-5ff318830a74 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:22.103671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3633c-37e3-4724-ab45-5ff318830a74 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:22.103671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3633c-37e3-4724-ab45-5ff318830a74 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:22.104957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:22.111446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6002b4-994c-487a-b3bb-2d431e886d87 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:22.112146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6002b4-994c-487a-b3bb-2d431e886d87 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:22.112451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6002b4-994c-487a-b3bb-2d431e886d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:22.188804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6d6002b4-994c-487a-b3bb-2d431e886d87 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:22.190052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6d6002b4-994c-487a-b3bb-2d431e886d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:22.221229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:22.302242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:22.603092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3633c-37e3-4724-ab45-5ff318830a74 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:22.604619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-63e3633c-37e3-4724-ab45-5ff318830a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:22.726618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3633c-37e3-4724-ab45-5ff318830a74 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:22.757911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:22.809759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:22.810403 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:22.810691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:22.810909 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:22.812568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:22.931624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:22.933087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545aed9-aac5-4db7-b0d6-b0e317a1581d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:22.952814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 723/1458] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:24.909734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b086f0-dd49-4a50-b7bd-71702cea65e6 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:24.910686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b086f0-dd49-4a50-b7bd-71702cea65e6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:24.910686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b086f0-dd49-4a50-b7bd-71702cea65e6 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:24.912521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:24.920489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2d2bf-0c69-4e66-a653-510085a71e64 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:24.920943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2d2bf-0c69-4e66-a653-510085a71e64 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:24.921038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2d2bf-0c69-4e66-a653-510085a71e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:24.989870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dea2d2bf-0c69-4e66-a653-510085a71e64 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:24.991085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dea2d2bf-0c69-4e66-a653-510085a71e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:25.000348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:25.101959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:25.384086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b086f0-dd49-4a50-b7bd-71702cea65e6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:25.386433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f3b086f0-dd49-4a50-b7bd-71702cea65e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:25.502744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b086f0-dd49-4a50-b7bd-71702cea65e6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:25.566609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:25.586800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:25.587424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:25.587701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:25.587966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:25.589574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:25.719514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:25.722068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d11c0-218e-4dae-b6a2-97c4d165c30b service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:25.745185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 737/1461] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:27.711375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f1e8-684e-4928-a3ee-896bb8c62433 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:27.711977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f1e8-684e-4928-a3ee-896bb8c62433 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:27.711977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f1e8-684e-4928-a3ee-896bb8c62433 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:27.714126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:27.721175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e26d-1db7-46a8-8b73-aa21a6dbef43 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:27.721691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e26d-1db7-46a8-8b73-aa21a6dbef43 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:27.721691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e26d-1db7-46a8-8b73-aa21a6dbef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:27.791122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d185e26d-1db7-46a8-8b73-aa21a6dbef43 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:27.792330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d185e26d-1db7-46a8-8b73-aa21a6dbef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:27.832174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:27.897930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:48:28.180767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f1e8-684e-4928-a3ee-896bb8c62433 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:28.183353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f8b0f1e8-684e-4928-a3ee-896bb8c62433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:28.303109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f1e8-684e-4928-a3ee-896bb8c62433 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:28.346667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:28.386212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:28.386923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:28.387201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:28.387460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:28.389069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:28.508364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:28.509736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c87d1-9bf5-4a40-b6ad-5ef377b0b713 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:28.530371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 726/1464] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:30.609904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c1e2b-bf13-4701-ba00-9c3f5b722a79 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:30.610512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c1e2b-bf13-4701-ba00-9c3f5b722a79 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:30.610512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c1e2b-bf13-4701-ba00-9c3f5b722a79 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:30.612709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:30.621678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91380-67f3-4c9c-bc64-78662a87e85c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:30.622180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91380-67f3-4c9c-bc64-78662a87e85c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:30.622281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91380-67f3-4c9c-bc64-78662a87e85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:30.692953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-99b91380-67f3-4c9c-bc64-78662a87e85c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:30.694207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-99b91380-67f3-4c9c-bc64-78662a87e85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:30.717566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:30.817633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:31.098792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c1e2b-bf13-4701-ba00-9c3f5b722a79 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:31.100346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a4c1e2b-bf13-4701-ba00-9c3f5b722a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:31.216960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c1e2b-bf13-4701-ba00-9c3f5b722a79 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:31.286495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:31.293812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:31.294457 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:31.294726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:31.294997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:31.296571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:31.420292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:31.421799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac9d94-012a-4e55-9004-2675e608b47f service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:31.440130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 740/1467] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:33.360085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59539-6f0d-4d4e-8b1b-443adde73c6f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:33.360670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59539-6f0d-4d4e-8b1b-443adde73c6f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:33.360670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59539-6f0d-4d4e-8b1b-443adde73c6f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:33.362577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:48:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:33.371286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99c73-e557-40b7-9969-6620c8c7e5e7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:33.372032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99c73-e557-40b7-9969-6620c8c7e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:33.372139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99c73-e557-40b7-9969-6620c8c7e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:33.446491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-02e99c73-e557-40b7-9969-6620c8c7e5e7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:33.447611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-02e99c73-e557-40b7-9969-6620c8c7e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:33.497258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:33.548356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:33.832802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59539-6f0d-4d4e-8b1b-443adde73c6f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:33.834373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9ea59539-6f0d-4d4e-8b1b-443adde73c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:33.947357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59539-6f0d-4d4e-8b1b-443adde73c6f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:33.997280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:34.026549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:34.027169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:34.027417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:34.027683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:34.029317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:34.145729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:34.147129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73ab1-0963-4b02-9310-b765e06e4c88 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:34.166731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 729/1470] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:43.546297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=22 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:44.163972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=66 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:53.697798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca339-d7e9-4fb0-92be-6691d86e9cd5 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:53.698385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca339-d7e9-4fb0-92be-6691d86e9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:53.698385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca339-d7e9-4fb0-92be-6691d86e9cd5 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:53.700341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 742/1471] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:53.707597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea2d0-60d7-4c1b-b4ab-b845b32821e2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:53.708027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea2d0-60d7-4c1b-b4ab-b845b32821e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:53.708216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea2d0-60d7-4c1b-b4ab-b845b32821e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:53.777247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2d3ea2d0-60d7-4c1b-b4ab-b845b32821e2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:53.778530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d3ea2d0-60d7-4c1b-b4ab-b845b32821e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:53.881143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 730/1472] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:54.199494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0435-dd18-49b0-a891-cbdbc30b5933 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:54.199780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0435-dd18-49b0-a891-cbdbc30b5933 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:54.200073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0435-dd18-49b0-a891-cbdbc30b5933 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:54.201421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 743/1473] 10.222.0.75 () {54 vars in 967 bytes} [Wed Aug 31 10:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:54.206553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b099ba-dd7b-447d-a84c-208b36dcb109 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:54.206834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b099ba-dd7b-447d-a84c-208b36dcb109 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:54.207098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b099ba-dd7b-447d-a84c-208b36dcb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:54.287310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a6b099ba-dd7b-447d-a84c-208b36dcb109 None None] MFA Rules not processed for user `7c86b5bf0b10480e88d5cc2d51ef1cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:54.288551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a6b099ba-dd7b-447d-a84c-208b36dcb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:54.310518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:54.373425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 731/1474] 10.222.0.75 () {58 vars in 1064 bytes} [Wed Aug 31 10:48:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:54.381080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b0435-dd18-49b0-a891-cbdbc30b5933 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:54.382655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-559b0435-dd18-49b0-a891-cbdbc30b5933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:54.501298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b0435-dd18-49b0-a891-cbdbc30b5933 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:54.575685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:54.576288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:54.576568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:54.576837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:54.578447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:54.642712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:54.705954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:54.708281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2623-3c38-4246-826d-5b4b751461b8 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:54.731884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 744/1475] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:56.722355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6a88b-c879-4bdd-b977-f030f37af1b2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:56.722923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6a88b-c879-4bdd-b977-f030f37af1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:56.722923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6a88b-c879-4bdd-b977-f030f37af1b2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:56.724322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 732/1476] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:56.730564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa448bc-7def-4297-96b5-3dc819b7b264 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:56.731030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa448bc-7def-4297-96b5-3dc819b7b264 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:56.731219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa448bc-7def-4297-96b5-3dc819b7b264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:56.810208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cfa448bc-7def-4297-96b5-3dc819b7b264 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:56.811435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cfa448bc-7def-4297-96b5-3dc819b7b264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:56.921119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 745/1477] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:57.196221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6a88b-c879-4bdd-b977-f030f37af1b2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:57.198742 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24a6a88b-c879-4bdd-b977-f030f37af1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:57.343787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6a88b-c879-4bdd-b977-f030f37af1b2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:57.397255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:57.445908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:57.446584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:57.446795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:57.447059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:57.447694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:57.449455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:48:57.449455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:48:57.449455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:48:57.450634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98097fcc-e532-40b2-97bf-683bcd387f90 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:57.469697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 733/1478] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Aug 31 10:48:57 2022] GET /identity/v3/projects => generated 2553 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:48:59.397250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975c50-cefc-447d-a5fd-4da66a9950a4 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:59.397846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975c50-cefc-447d-a5fd-4da66a9950a4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:59.397846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975c50-cefc-447d-a5fd-4da66a9950a4 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:59.399224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 746/1479] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:48:59.404718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae54d-eb4a-4b19-9b6e-f1828dc6c7c4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:59.405158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae54d-eb4a-4b19-9b6e-f1828dc6c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:59.405252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae54d-eb4a-4b19-9b6e-f1828dc6c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:59.474294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-233ae54d-eb4a-4b19-9b6e-f1828dc6c7c4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:59.475973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-233ae54d-eb4a-4b19-9b6e-f1828dc6c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:59.584709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 734/1480] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:59.873511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975c50-cefc-447d-a5fd-4da66a9950a4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:59.875222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-31975c50-cefc-447d-a5fd-4da66a9950a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:59.885512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:00.043502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975c50-cefc-447d-a5fd-4da66a9950a4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:00.139910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:00.177544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:00.178186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:00.178505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:00.178772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:00.180351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:00.275656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:00.277268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90332fef-289a-4633-ba04-c54a7ed432d8 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:00.296555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 747/1481] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:02.383650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f395-036a-4249-aef0-99ed1994dbc2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:02.384332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f395-036a-4249-aef0-99ed1994dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:02.384332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f395-036a-4249-aef0-99ed1994dbc2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:02.385606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 735/1482] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:49:02.392132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd30009-c817-4302-a855-1fe42e44c927 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:02.392928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd30009-c817-4302-a855-1fe42e44c927 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:02.393109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd30009-c817-4302-a855-1fe42e44c927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:02.472756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5fd30009-c817-4302-a855-1fe42e44c927 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:02.474006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5fd30009-c817-4302-a855-1fe42e44c927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:02.538611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:02.592666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 748/1483] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:02.880464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f395-036a-4249-aef0-99ed1994dbc2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:02.882889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f15f395-036a-4249-aef0-99ed1994dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:02.913072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:02.995111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f395-036a-4249-aef0-99ed1994dbc2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:03.094295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:03.094935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:03.095253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:03.095610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:03.098171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:03.178609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:03.221131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:03.222629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e5536-e450-41f6-8e1a-f3018d6fa7c6 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:03.245156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 736/1484] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:05.201916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c95d1-d256-4b54-a304-26a9f53d5d30 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.202470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c95d1-d256-4b54-a304-26a9f53d5d30 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.202470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c95d1-d256-4b54-a304-26a9f53d5d30 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.204539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 749/1485] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:49:05.212919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5563-4d83-4343-bf9b-9f227542fd45 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.213320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5563-4d83-4343-bf9b-9f227542fd45 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.213451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5563-4d83-4343-bf9b-9f227542fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.405945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f8ff5563-4d83-4343-bf9b-9f227542fd45 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:05.407204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f8ff5563-4d83-4343-bf9b-9f227542fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.516465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 737/1486] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:05.807072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c95d1-d256-4b54-a304-26a9f53d5d30 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:05.808616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0c7c95d1-d256-4b54-a304-26a9f53d5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.918859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c95d1-d256-4b54-a304-26a9f53d5d30 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:05.992811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:05.994728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:05.995376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.995658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.995937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.998168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:06.119293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:06.120653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae34d31-5fae-4800-9798-46be48abd0b4 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:06.139851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 750/1487] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:08.132272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfcbae-cb10-49d8-84b1-3e900a48181a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:08.133086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfcbae-cb10-49d8-84b1-3e900a48181a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:08.133086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfcbae-cb10-49d8-84b1-3e900a48181a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:08.135307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 738/1488] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:49:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:49:08.144286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317aa00-4d80-4577-b8be-89e205442d25 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:08.144994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317aa00-4d80-4577-b8be-89e205442d25 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:08.145222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317aa00-4d80-4577-b8be-89e205442d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:08.222956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d317aa00-4d80-4577-b8be-89e205442d25 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:08.224170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d317aa00-4d80-4577-b8be-89e205442d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:08.277865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:08.330605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 751/1489] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:08.629662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfcbae-cb10-49d8-84b1-3e900a48181a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:08.631214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5cbfcbae-cb10-49d8-84b1-3e900a48181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:08.671913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:08.746192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfcbae-cb10-49d8-84b1-3e900a48181a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:08.821558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:08.822199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:08.822443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:08.822730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:08.824289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:08.913626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:08.948943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:08.950410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47602744-4d47-4c1c-82dc-9542c4ef1101 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:08.969544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 739/1490] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:11.158291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464845fc-c6ab-45ed-90c4-62e9cfaf501c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:11.158836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464845fc-c6ab-45ed-90c4-62e9cfaf501c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:11.158836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464845fc-c6ab-45ed-90c4-62e9cfaf501c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:11.160096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 752/1491] 10.222.0.75 () {54 vars in 927 bytes} [Wed Aug 31 10:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:49:11.166607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294fe1-b74f-4d39-9280-9860184d2781 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:11.167330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294fe1-b74f-4d39-9280-9860184d2781 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:11.167535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294fe1-b74f-4d39-9280-9860184d2781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:11.241690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-40294fe1-b74f-4d39-9280-9860184d2781 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:11.243126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-40294fe1-b74f-4d39-9280-9860184d2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:11.352753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 740/1492] 10.222.0.75 () {58 vars in 1024 bytes} [Wed Aug 31 10:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:11.653636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464845fc-c6ab-45ed-90c4-62e9cfaf501c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:11.656022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-464845fc-c6ab-45ed-90c4-62e9cfaf501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:11.774797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464845fc-c6ab-45ed-90c4-62e9cfaf501c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:11.857293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:11.857938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:11.858217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:11.858491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:11.860090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:11.869668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:11.982022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:11.983476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd554df-bf2e-4c8d-a8b8-cbcb1cf050f4 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:12.001368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 753/1493] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:21.350615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=82 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:21.999244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=50 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:27.027409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:27.028047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:27.028047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:27.119310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:27.120458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:27.224434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 741/1494] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:27.237406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:27.238241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:27.238241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:27.448510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:27.449692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:27.551616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 754/1495] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:27.557244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:27.559327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:27.577738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5bcd3-015d-447d-9c59-31efbe5b3b83 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:27.643424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:27.680376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:27.680988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:27.681256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:27.681538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:27.682222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:50:27.682515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:27.683564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:27.683564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:50:27.683564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:50:27.684441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:27.696714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 742/1496] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:50:27.705263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:27.715377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146dddb-600f-4fe2-940d-c8c3afbcd502 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:27.788014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:27.822683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:27.823325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:27.823608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:27.823879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:27.824515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:27.826303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:27.826303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:50:27.826303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:50:27.827535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:27.884900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 755/1497] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:50:27 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:50:27.889181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:27.890709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:27.926373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760daa1-a11c-4cfd-a46b-cd687e93e352 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:28.021991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:28.022518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.022784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.023022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.023672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:28.024679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:28.024679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:50:28.024679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:50:28.025890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:28.072847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 743/1498] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:50:27 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:50:28.078725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:28.080224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:28.143185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f5dd-01d0-4395-9c78-539cccc41ac1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:28.246565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:28.259445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:28.260050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.260322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.260584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.261208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:28.262251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:28.262251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:50:28.262251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:50:28.263130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:28.277373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 756/1499] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:50:28.281940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:28.283435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:28.295099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ab25-ec10-49a0-bb02-1eba59f25db1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:28.320880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:28.403567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:28.404182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.404453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.404717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.405358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:28.406407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:28.406407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:50:28.406407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:50:28.407286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa4737-4618-413c-ae70-ab92c53ad48b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:28.420453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 744/1500] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:50:28.425162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:28.426821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:28.464082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7938b-8ec5-4a44-9fcf-4f4693b4d362 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:28.567678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:28.568244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.568515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.568786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] PATH_INFO: `/v3/projects/cdd2a8d063924b6baef8f6095a9b9b56/users/8e46703f11984b828df6decf0e01eaff/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.590928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd2a8d063924b6baef8f6095a9b9b56, user_id=8e46703f11984b828df6decf0e01eaff, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:28.591959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:28.591959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:50:28.591959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:50:28.593908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289909-52d5-4fd2-8677-55aaa29bc4a6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:28.619312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 757/1501] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:50:28 2022] PUT /identity/v3/projects/cdd2a8d063924b6baef8f6095a9b9b56/users/8e46703f11984b828df6decf0e01eaff/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:50:28.631833 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd10db-99ba-4899-b6e7-4ba647bb90c7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.632122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd10db-99ba-4899-b6e7-4ba647bb90c7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.632390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd10db-99ba-4899-b6e7-4ba647bb90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.692114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-28fd10db-99ba-4899-b6e7-4ba647bb90c7 None None] MFA Rules not processed for user `8e46703f11984b828df6decf0e01eaff`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:28.693373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-28fd10db-99ba-4899-b6e7-4ba647bb90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:28.772619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 745/1502] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:28.786830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c758-6523-46a7-8fac-2e98d54fed54 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.787114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c758-6523-46a7-8fac-2e98d54fed54 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.787386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c758-6523-46a7-8fac-2e98d54fed54 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.788759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 758/1503] 10.222.0.75 () {54 vars in 964 bytes} [Wed Aug 31 10:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:28.793592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce3eb5-76f3-40f8-8a71-3a22aa394c20 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:28.793908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce3eb5-76f3-40f8-8a71-3a22aa394c20 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:28.794181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce3eb5-76f3-40f8-8a71-3a22aa394c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:28.830132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:28.875694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c2ce3eb5-76f3-40f8-8a71-3a22aa394c20 None None] MFA Rules not processed for user `b52dcd18d699460b8a4d298a381a35d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:28.876906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2ce3eb5-76f3-40f8-8a71-3a22aa394c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:28.961580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 746/1504] 10.222.0.75 () {58 vars in 1061 bytes} [Wed Aug 31 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:28.976708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330c758-6523-46a7-8fac-2e98d54fed54 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:28.979141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f330c758-6523-46a7-8fac-2e98d54fed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:29.046069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:29.103022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330c758-6523-46a7-8fac-2e98d54fed54 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:29.179830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:29.180565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:29.180852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:29.181128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:29.182783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:29.297270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:29.298751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:29.302259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:29.317645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 759/1505] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:29.363008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24ff4-8690-4255-a7f6-c7270b75530e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:29.363469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24ff4-8690-4255-a7f6-c7270b75530e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:29.363578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24ff4-8690-4255-a7f6-c7270b75530e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:29.364914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 747/1506] 10.222.0.75 () {52 vars in 830 bytes} [Wed Aug 31 10:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:29.368761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:29.370025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:29.482538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666b2a-7eba-44a5-9a40-66778f3fa91d service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:29.591092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:29.591954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:29.592291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:29.592553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] PATH_INFO: `/v3/users/8e46703f11984b828df6decf0e01eaff` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:29.607942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e46703f11984b828df6decf0e01eaff)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:29.609642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:29.609642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:50:29.609642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:50:29.611712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:29.625838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:29.685683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e46703f11984b828df6decf0e01eaff'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:29.686140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e46703f11984b828df6decf0e01eaff'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:29.697796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e46703f11984b828df6decf0e01eaff'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:29.698301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e46703f11984b828df6decf0e01eaff'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:29.721695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e46703f11984b828df6decf0e01eaff'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:29.740782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 760/1507] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:50:29 2022] DELETE /identity/v3/users/8e46703f11984b828df6decf0e01eaff => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:50:29.745457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:29.745880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:29.746222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:29.802668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:29.803863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:29.883868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:29.897420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 748/1508] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:29.909090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:29.910346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:30.014138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8177d-aae6-4111-9096-0b8ace7554e8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:30.076030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:30.104543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:30.105225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:30.105504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:30.105758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:30.107409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:30.247603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:30.249061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d06861-7a72-4b3c-8e19-235dd4e55e9c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:30.271825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 761/1509] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:30.735925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:30.738506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:30.750928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3214a-38e2-442d-92fc-d0e649daf7a9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:30.866016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:30.866668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:30.866951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:30.867197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] PATH_INFO: `/v3/projects/cdd2a8d063924b6baef8f6095a9b9b56` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:30.877808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd2a8d063924b6baef8f6095a9b9b56)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:30.878874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:50:30.878874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:50:30.878874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:50:30.880127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:30.961004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd2a8d063924b6baef8f6095a9b9b56', 'request_id': 'req-c292bb2e-82dd-4c9a-870a-7de58ab181bd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:30.975210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd2a8d063924b6baef8f6095a9b9b56', 'request_id': 'req-c292bb2e-82dd-4c9a-870a-7de58ab181bd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:30.990553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd2a8d063924b6baef8f6095a9b9b56', 'request_id': 'req-c292bb2e-82dd-4c9a-870a-7de58ab181bd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:31.023172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] The token cache is being invalidate because project cdd2a8d063924b6baef8f6095a9b9b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:50:31.023431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:31.024013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c292bb2e-82dd-4c9a-870a-7de58ab181bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:50:31.025370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 749/1510] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:50:30 2022] DELETE /identity/v3/projects/cdd2a8d063924b6baef8f6095a9b9b56 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:50:40.269322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=62 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:41.020039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:06.025998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7000c-4a69-439a-ab3d-b7bb772750ee None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:06.026581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7000c-4a69-439a-ab3d-b7bb772750ee None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:06.026581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7000c-4a69-439a-ab3d-b7bb772750ee None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:06.028557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:52:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:06.037303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739107-c99a-49cc-81b9-e02b4275ee0b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:06.037726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739107-c99a-49cc-81b9-e02b4275ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:06.037933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739107-c99a-49cc-81b9-e02b4275ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:06.131312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f2739107-c99a-49cc-81b9-e02b4275ee0b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:06.132551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f2739107-c99a-49cc-81b9-e02b4275ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:06.248307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:06.403122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7000c-4a69-439a-ab3d-b7bb772750ee None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:06.406872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-efc7000c-4a69-439a-ab3d-b7bb772750ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:06.538422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7000c-4a69-439a-ab3d-b7bb772750ee None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:06.544589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b5e02-48f3-45af-a89e-ef18cc2ab758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:06.545204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5e02-48f3-45af-a89e-ef18cc2ab758 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:06.545471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5e02-48f3-45af-a89e-ef18cc2ab758 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:06.545748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5e02-48f3-45af-a89e-ef18cc2ab758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:06.554109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b5e02-48f3-45af-a89e-ef18cc2ab758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:06.555728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b5e02-48f3-45af-a89e-ef18cc2ab758 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:06.565538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 763/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:07.408580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bca32-2696-4595-928f-09eae5dafef5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:07.409187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bca32-2696-4595-928f-09eae5dafef5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:07.409187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bca32-2696-4595-928f-09eae5dafef5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:07.410593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:07.416850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10973-ccdb-4993-876e-d633ee5111f1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:07.417550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10973-ccdb-4993-876e-d633ee5111f1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:07.417736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10973-ccdb-4993-876e-d633ee5111f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:07.443988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-69b10973-ccdb-4993-876e-d633ee5111f1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:07.445221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-69b10973-ccdb-4993-876e-d633ee5111f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:07.454571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:07.609482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bca32-2696-4595-928f-09eae5dafef5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:07.626007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bca32-2696-4595-928f-09eae5dafef5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:07.631766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591782c4-d3b4-4424-9ddc-68e42ff643f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:07.632383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591782c4-d3b4-4424-9ddc-68e42ff643f9 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:07.632651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591782c4-d3b4-4424-9ddc-68e42ff643f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:07.632921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591782c4-d3b4-4424-9ddc-68e42ff643f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:07.641413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591782c4-d3b4-4424-9ddc-68e42ff643f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:07.643070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591782c4-d3b4-4424-9ddc-68e42ff643f9 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:07.654282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 752/1516] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:08.504641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb639a5-35d6-442b-af4e-1837e720011d None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:08.505495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb639a5-35d6-442b-af4e-1837e720011d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:08.505495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb639a5-35d6-442b-af4e-1837e720011d None None] PATH_INFO: `/v3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:08.507716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 765/1517] 10.222.0.71 () {54 vars in 925 bytes} [Wed Aug 31 10:52:08 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:08.516181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235317-3106-40d9-a5ca-dd76e351b4ca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:08.516898 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235317-3106-40d9-a5ca-dd76e351b4ca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:08.517045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235317-3106-40d9-a5ca-dd76e351b4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:08.582071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e0235317-3106-40d9-a5ca-dd76e351b4ca None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:08.583274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e0235317-3106-40d9-a5ca-dd76e351b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:08.601739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:08.661699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 753/1518] 10.222.0.71 () {58 vars in 1015 bytes} [Wed Aug 31 10:52:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:12.642829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7aaf1-682b-4b98-80ca-80efd954d042 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:12.643338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7aaf1-682b-4b98-80ca-80efd954d042 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:12.643338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7aaf1-682b-4b98-80ca-80efd954d042 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:12.644729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 766/1519] 10.222.0.75 () {54 vars in 961 bytes} [Wed Aug 31 10:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:12.649976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2ede-d550-4481-87ba-fd1b499d7f77 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:12.650425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2ede-d550-4481-87ba-fd1b499d7f77 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:12.650524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2ede-d550-4481-87ba-fd1b499d7f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:12.669911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-127a2ede-d550-4481-87ba-fd1b499d7f77 None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:12.671083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-127a2ede-d550-4481-87ba-fd1b499d7f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:12.679848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 754/1520] 10.222.0.75 () {58 vars in 1058 bytes} [Wed Aug 31 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:12.688588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7aaf1-682b-4b98-80ca-80efd954d042 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:12.711391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7aaf1-682b-4b98-80ca-80efd954d042 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:12.717410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b8b95-5b5c-4992-928a-16ebfb4af32b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:12.718049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b8b95-5b5c-4992-928a-16ebfb4af32b service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:12.718321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b8b95-5b5c-4992-928a-16ebfb4af32b service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:12.718600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b8b95-5b5c-4992-928a-16ebfb4af32b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:12.727226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b8b95-5b5c-4992-928a-16ebfb4af32b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:12.728810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b8b95-5b5c-4992-928a-16ebfb4af32b service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:12.738413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 767/1521] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:18.891073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17283f-a2bc-47d7-9b8b-350eef21bcb5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:18.891614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17283f-a2bc-47d7-9b8b-350eef21bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:18.891614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17283f-a2bc-47d7-9b8b-350eef21bcb5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:18.892997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:18.898018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cec8f0-17fc-47a8-b8e9-fb0dd7200c6f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:18.898496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cec8f0-17fc-47a8-b8e9-fb0dd7200c6f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:18.898496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cec8f0-17fc-47a8-b8e9-fb0dd7200c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:18.926483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e9cec8f0-17fc-47a8-b8e9-fb0dd7200c6f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:18.928378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e9cec8f0-17fc-47a8-b8e9-fb0dd7200c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:18.939212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:19.102124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17283f-a2bc-47d7-9b8b-350eef21bcb5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:19.124667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17283f-a2bc-47d7-9b8b-350eef21bcb5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:19.131676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e22da-656d-41c4-83d2-0aadd3c9645d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:19.132218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e22da-656d-41c4-83d2-0aadd3c9645d service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:19.132471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e22da-656d-41c4-83d2-0aadd3c9645d service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:19.132732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e22da-656d-41c4-83d2-0aadd3c9645d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:19.141570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e22da-656d-41c4-83d2-0aadd3c9645d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:19.143216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e22da-656d-41c4-83d2-0aadd3c9645d service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:19.153141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 756/1524] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:19.970587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a052-df7b-49d6-b8f6-349260deebea None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:19.971428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a052-df7b-49d6-b8f6-349260deebea None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:19.971428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a052-df7b-49d6-b8f6-349260deebea None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:19.973569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:19.978789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63119cdb-300f-4913-9098-e97e8e609d7a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:19.979227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63119cdb-300f-4913-9098-e97e8e609d7a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:19.979321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63119cdb-300f-4913-9098-e97e8e609d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:19.999468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-63119cdb-300f-4913-9098-e97e8e609d7a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:20.000663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-63119cdb-300f-4913-9098-e97e8e609d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:20.009626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:20.174364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a052-df7b-49d6-b8f6-349260deebea None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:20.195150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a052-df7b-49d6-b8f6-349260deebea None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:20.202192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6400-4393-4b13-9fb0-ec06ffb3b585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:20.202831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6400-4393-4b13-9fb0-ec06ffb3b585 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:20.203117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6400-4393-4b13-9fb0-ec06ffb3b585 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:20.203393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6400-4393-4b13-9fb0-ec06ffb3b585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:20.212415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6400-4393-4b13-9fb0-ec06ffb3b585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:20.214061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6400-4393-4b13-9fb0-ec06ffb3b585 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:20.223614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 770/1527] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:24.252084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b32d-ab7d-4f3c-9203-7cebc9e2ccbd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:24.252707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b32d-ab7d-4f3c-9203-7cebc9e2ccbd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:24.252707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b32d-ab7d-4f3c-9203-7cebc9e2ccbd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:24.254020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:24.259584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be0db-2c75-41aa-b3be-bee280753867 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:24.260047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be0db-2c75-41aa-b3be-bee280753867 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:24.260156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be0db-2c75-41aa-b3be-bee280753867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:24.282102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-793be0db-2c75-41aa-b3be-bee280753867 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:24.283295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-793be0db-2c75-41aa-b3be-bee280753867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:24.292595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:24.580169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b32d-ab7d-4f3c-9203-7cebc9e2ccbd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:24.583389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2a02b32d-ab7d-4f3c-9203-7cebc9e2ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:24.669219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b32d-ab7d-4f3c-9203-7cebc9e2ccbd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:24.673143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa778c7f-eb6b-4359-b5cd-5a511b7a5612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:24.673746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa778c7f-eb6b-4359-b5cd-5a511b7a5612 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:24.674048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa778c7f-eb6b-4359-b5cd-5a511b7a5612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:24.674315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa778c7f-eb6b-4359-b5cd-5a511b7a5612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:24.684109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa778c7f-eb6b-4359-b5cd-5a511b7a5612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:24.685546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa778c7f-eb6b-4359-b5cd-5a511b7a5612 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:24.695243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 759/1530] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:26.582086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754fbc-ee69-4587-b096-b1d6165d378c None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.582641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754fbc-ee69-4587-b096-b1d6165d378c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.582641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754fbc-ee69-4587-b096-b1d6165d378c None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.583920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:26.590322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b0cc7-3b13-470f-9c9b-479564a449cd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.591055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b0cc7-3b13-470f-9c9b-479564a449cd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.591229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b0cc7-3b13-470f-9c9b-479564a449cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.617255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fd5b0cc7-3b13-470f-9c9b-479564a449cd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:26.618488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fd5b0cc7-3b13-470f-9c9b-479564a449cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:26.627686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:26.916083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754fbc-ee69-4587-b096-b1d6165d378c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.934843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754fbc-ee69-4587-b096-b1d6165d378c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.939082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95297f19-5569-47b4-9ecb-f164cb067aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.939696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95297f19-5569-47b4-9ecb-f164cb067aff service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.939972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95297f19-5569-47b4-9ecb-f164cb067aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.940243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95297f19-5569-47b4-9ecb-f164cb067aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.949804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95297f19-5569-47b4-9ecb-f164cb067aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.951301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95297f19-5569-47b4-9ecb-f164cb067aff service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.961026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 773/1533] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:30.355432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64db3-39eb-487e-9c2c-0f6e85b209b8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:30.356003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64db3-39eb-487e-9c2c-0f6e85b209b8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:30.356003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64db3-39eb-487e-9c2c-0f6e85b209b8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:30.357349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:30.362914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133546f8-4623-4765-a26a-9884752d9b1e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:30.363362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133546f8-4623-4765-a26a-9884752d9b1e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:30.363459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133546f8-4623-4765-a26a-9884752d9b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:30.371792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:30.386024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-133546f8-4623-4765-a26a-9884752d9b1e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:30.387313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-133546f8-4623-4765-a26a-9884752d9b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:30.396645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:30.947393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d64db3-39eb-487e-9c2c-0f6e85b209b8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:30.950129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85d64db3-39eb-487e-9c2c-0f6e85b209b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:31.019256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:31.034171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d64db3-39eb-487e-9c2c-0f6e85b209b8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:31.038308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe409e-177a-478a-a0f7-ed6e4e45ab89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:31.038907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe409e-177a-478a-a0f7-ed6e4e45ab89 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:31.039181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe409e-177a-478a-a0f7-ed6e4e45ab89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:31.039447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe409e-177a-478a-a0f7-ed6e4e45ab89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:31.050163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe409e-177a-478a-a0f7-ed6e4e45ab89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:31.051604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe409e-177a-478a-a0f7-ed6e4e45ab89 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:31.061602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 762/1536] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:32.988427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db0d2-327a-4b79-a7db-3a73f9ddfb03 None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:32.989356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db0d2-327a-4b79-a7db-3a73f9ddfb03 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:32.989356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db0d2-327a-4b79-a7db-3a73f9ddfb03 None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:32.991404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:32.997761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74ff24-8ac5-435f-a69b-ef946ab97453 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:32.998253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74ff24-8ac5-435f-a69b-ef946ab97453 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:32.998361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74ff24-8ac5-435f-a69b-ef946ab97453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:33.028110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8a74ff24-8ac5-435f-a69b-ef946ab97453 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:33.029323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8a74ff24-8ac5-435f-a69b-ef946ab97453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:33.037538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:33.616122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db0d2-327a-4b79-a7db-3a73f9ddfb03 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:33.618220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-708db0d2-327a-4b79-a7db-3a73f9ddfb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:33.633496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db0d2-327a-4b79-a7db-3a73f9ddfb03 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:33.638294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0bfb-6624-4f84-bd7f-9cafa3f66afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:33.638892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0bfb-6624-4f84-bd7f-9cafa3f66afb service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:33.639185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0bfb-6624-4f84-bd7f-9cafa3f66afb service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:33.639455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0bfb-6624-4f84-bd7f-9cafa3f66afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:33.652947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0bfb-6624-4f84-bd7f-9cafa3f66afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:33.654969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0bfb-6624-4f84-bd7f-9cafa3f66afb service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:33.665807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 776/1539] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:43.020818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=11 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:43.661327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=8 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:01.989427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdefa0-5bf5-4e37-8370-fb427911dada None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.991119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdefa0-5bf5-4e37-8370-fb427911dada None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.991119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdefa0-5bf5-4e37-8370-fb427911dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.027288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-78fdefa0-5bf5-4e37-8370-fb427911dada None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.028911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-78fdefa0-5bf5-4e37-8370-fb427911dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.039041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 764/1540] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.047965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.048953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.049456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.073314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.075113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.084777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8e32-779b-4ce6-bf57-45014cbfbda5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.085544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8e32-779b-4ce6-bf57-45014cbfbda5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.086083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8e32-779b-4ce6-bf57-45014cbfbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.105276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 777/1541] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.110912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.128661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-172a8e32-779b-4ce6-bf57-45014cbfbda5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.131507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd0eb2-ce29-4923-b792-c34daf083c55 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.132968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-172a8e32-779b-4ce6-bf57-45014cbfbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.146188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.148395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.148922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.149919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.151203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.151889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.153574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:54:02.153574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:54:02.153574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:54:02.155721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.157489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 765/1542] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:02.167327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c588b-f302-4669-8518-0409cefdf7f3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.168401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c588b-f302-4669-8518-0409cefdf7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.168913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c588b-f302-4669-8518-0409cefdf7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.185607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 778/1543] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:02.197433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.219536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8b4c588b-f302-4669-8518-0409cefdf7f3 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.220783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8b4c588b-f302-4669-8518-0409cefdf7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.222207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa0d4d-d34d-4e44-b327-e0edaaa02930 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.233140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 766/1544] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.234556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.234885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.235160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.236224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153a2c8-f112-476f-b2f5-74c3d2755477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.237252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a2c8-f112-476f-b2f5-74c3d2755477 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.237760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a2c8-f112-476f-b2f5-74c3d2755477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.238391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a2c8-f112-476f-b2f5-74c3d2755477 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.239375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153a2c8-f112-476f-b2f5-74c3d2755477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.241987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153a2c8-f112-476f-b2f5-74c3d2755477 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.272374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.273578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.289074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 767/1545] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.289911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.310271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a928-73f9-4cd2-9be7-05d14a514c25 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.320422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.321122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.321396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.321663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.322362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.322658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.324296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.339797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 779/1546] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:02.341152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.341438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.341712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.372198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 768/1547] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:02.372891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.395464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.396676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.400054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0e384-1505-4234-a374-1b3aff66e9c1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.488606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 780/1548] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.489634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.502203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda112d-700e-4c1d-ba8f-411364335151 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.504673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06659aa0-5031-4c9f-bf45-081dc1861ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.505636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06659aa0-5031-4c9f-bf45-081dc1861ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.506308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06659aa0-5031-4c9f-bf45-081dc1861ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.506958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06659aa0-5031-4c9f-bf45-081dc1861ccc admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.507371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbeff5-5f22-4d80-b43c-3510d4049a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.507978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbeff5-5f22-4d80-b43c-3510d4049a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.508255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbeff5-5f22-4d80-b43c-3510d4049a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.508511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06659aa0-5031-4c9f-bf45-081dc1861ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.508628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbeff5-5f22-4d80-b43c-3510d4049a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.509208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbeff5-5f22-4d80-b43c-3510d4049a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.511013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06659aa0-5031-4c9f-bf45-081dc1861ccc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.511146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbeff5-5f22-4d80-b43c-3510d4049a73 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.538402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 769/1549] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:02.540162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2abe11-fd19-4dbd-92c1-e721ed06ab51 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.540698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2abe11-fd19-4dbd-92c1-e721ed06ab51 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.541229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2abe11-fd19-4dbd-92c1-e721ed06ab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.553561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 781/1550] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:02.554873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.555158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.555430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.564791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bf2abe11-fd19-4dbd-92c1-e721ed06ab51 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.566053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bf2abe11-fd19-4dbd-92c1-e721ed06ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.575628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.576844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.626524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 770/1551] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.627795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.628084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.628353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.644957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 782/1552] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.644957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.648221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.649426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.650460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966635-6cae-4c62-bd18-faf03479df12 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.655059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.655661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.655940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.656208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.656850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.657150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.658505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 771/1553] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.658783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3ba58-91ba-40ef-932e-7cfa2b2381a6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.659447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.670807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 783/1554] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:02.671367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a7b5-37dd-45c0-a7c8-daf99be134af None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.672097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2363c-1891-40c2-9e29-d23a2335a0d9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.672376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2363c-1891-40c2-9e29-d23a2335a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.672695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2363c-1891-40c2-9e29-d23a2335a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.676937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.677814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.678343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.678685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.679397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.682482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.692584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-25d2363c-1891-40c2-9e29-d23a2335a0d9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.692764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 772/1555] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:02.693471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.693877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-25d2363c-1891-40c2-9e29-d23a2335a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.702007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 784/1556] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.703234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a95201-71f8-497e-b52e-4649dd19775c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.703359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4d1e-dc44-4c53-9b68-18fb3e1cffa3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.703721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a95201-71f8-497e-b52e-4649dd19775c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.703844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a95201-71f8-497e-b52e-4649dd19775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.709705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e72efe-bb7e-4d43-ae60-86531ba74dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.710328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e72efe-bb7e-4d43-ae60-86531ba74dce admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.710603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e72efe-bb7e-4d43-ae60-86531ba74dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.710873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e72efe-bb7e-4d43-ae60-86531ba74dce admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.711506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e72efe-bb7e-4d43-ae60-86531ba74dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.713416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e72efe-bb7e-4d43-ae60-86531ba74dce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.722936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13a95201-71f8-497e-b52e-4649dd19775c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.724125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13a95201-71f8-497e-b52e-4649dd19775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.732414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 785/1557] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.738373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 773/1558] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:02.738373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ed00-69d5-419a-9be3-cd7f6f12f43e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.738373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ed00-69d5-419a-9be3-cd7f6f12f43e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.738373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ed00-69d5-419a-9be3-cd7f6f12f43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.739974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.740289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.740598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.748122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:02.757484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2532ed00-69d5-419a-9be3-cd7f6f12f43e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.758712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2532ed00-69d5-419a-9be3-cd7f6f12f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.761860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.763203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.770313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 774/1559] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.770313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.770313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.770313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.777970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 786/1560] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.777970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.784276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5156d-fa37-4213-8b70-3433af5133fd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.787479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.788735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.789242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292ce9-205d-4257-ad9c-78944413515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.789858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292ce9-205d-4257-ad9c-78944413515c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.790140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292ce9-205d-4257-ad9c-78944413515c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.790467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292ce9-205d-4257-ad9c-78944413515c admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.791043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf292ce9-205d-4257-ad9c-78944413515c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.793190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf292ce9-205d-4257-ad9c-78944413515c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.797143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 775/1561] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.798261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.803914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:02.810784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1adbc-8991-416c-8725-93bf3ba67bf8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.816573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.817202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.817481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.817752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.818434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.820145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.822371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 787/1562] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:02.823407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba422a5e-7562-4d3b-a961-ba098280e31c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.823691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba422a5e-7562-4d3b-a961-ba098280e31c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.823961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba422a5e-7562-4d3b-a961-ba098280e31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.837221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 776/1563] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:02.837221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.844972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a745e1-aca5-47a6-a628-ed8a0a86105c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.849685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ba422a5e-7562-4d3b-a961-ba098280e31c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.851006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ba422a5e-7562-4d3b-a961-ba098280e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.901625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.902291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.902566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.902831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.903494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.905088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.909796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 788/1564] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.911079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.911386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.911681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.918818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 777/1565] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:02.919698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.932604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.933831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.940335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0492d-40f2-4305-b919-5aaddc8fc4a8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.941746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 789/1566] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.942549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.949331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.949983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.950267 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.950538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.951238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.951539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.951893 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58ed8d-a9f8-46b6-bde8-e5bd4b7c187e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.953256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.957106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.957712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.958022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.958293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.958931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.959234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.960914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.966762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 778/1567] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:02.967583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.977826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 790/1568] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:02.977826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.982470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9427-bd78-4c99-9bab-03573c737bdd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.985412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db15c3-74ab-4d73-a9ae-ce884dca28a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.987518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.988134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.988410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.988679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.989367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.989665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.990388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.991117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.991423 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.991519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.991691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.992310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.993314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:54:02.993314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:54:02.993314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:54:02.994533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.004003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 779/1569] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:03.004778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.014734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b177-122f-4bf7-a626-749c3b62e4ae admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.020197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.020854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.021134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.021409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] PATH_INFO: `/v3/projects/92a4742f10394b1cb1698143ac53011d/users/e44d3f7f4e0a411fa2416ae5f466eabb/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.024818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 791/1570] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/users => generated 304 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.025804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.035378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb70126-a2f0-4e3d-b7e2-8e7bb9248da6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.037001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a4742f10394b1cb1698143ac53011d, user_id=e44d3f7f4e0a411fa2416ae5f466eabb, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.038102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:54:03.038102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:54:03.038102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:54:03.039967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.040088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.040605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.040834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.041102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.041753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:03.042072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.043663 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.053759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 780/1571] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:03 2022] PUT /identity/v3/projects/92a4742f10394b1cb1698143ac53011d/users/e44d3f7f4e0a411fa2416ae5f466eabb/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:03.054582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.063017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 792/1572] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:03.063017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.072094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d91c3-6b80-43d0-a8b0-ab1222b426a4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.126817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706122f5-1bfe-4934-9076-1b62a8d1f852 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.132015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.132634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.132904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.133185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.133914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.135620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.136470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.137274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.137553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.138188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.138827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:03.139123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.140718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.145659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 781/1573] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.146553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.160029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 793/1574] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:03.160029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.160325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef395e-ab41-4abe-9f04-c2950f2a8001 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.161518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.161666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.161977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.162250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.162911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.163917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:54:03.163917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:54:03.163917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:54:03.165106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.169639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d9390-2c5b-4180-a884-9900872950be admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.174473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.175078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.175355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.176473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.176690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.178692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.195851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 782/1575] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.196463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.196711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.211073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.211780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 794/1576] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.212667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.263155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a63b-a262-42af-ac81-3164ab27e49f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.273390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868871a-afe8-41d0-a1db-33866c691238 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.278244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.278861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.279138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.279406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.280105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.281749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.292052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 795/1577] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.292777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.304100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690bfc-ed3e-4313-a3d6-887f8cc4b32c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.309368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e045-2c7d-412c-96cf-713aa9544072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.310003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e045-2c7d-412c-96cf-713aa9544072 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.310278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e045-2c7d-412c-96cf-713aa9544072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.310541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e045-2c7d-412c-96cf-713aa9544072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.311165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87e045-2c7d-412c-96cf-713aa9544072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.313079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87e045-2c7d-412c-96cf-713aa9544072 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.330862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.331762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.332041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.332352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.333007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.335274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.342249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 796/1578] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.343698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.343986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.344259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.366567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 783/1579] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.366567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.372731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] MFA Rules not processed for user `e44d3f7f4e0a411fa2416ae5f466eabb`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:03.374091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.424475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a5f5-91c0-48be-9b07-7e7c531a2300 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.429599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.430354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.430631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.430905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] PATH_INFO: `/v3/projects/1aa7cb99f3b44a85b984b80ad08e17c5/users/c31a0c08c7a249caadd609a3e772c1c2/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.441532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 797/1580] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:03.442520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.449385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa7cb99f3b44a85b984b80ad08e17c5, user_id=c31a0c08c7a249caadd609a3e772c1c2, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.452098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.455555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239cb2d-7d01-49cd-9e01-b39ee788438f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.461016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.461987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.462268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.462539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.463181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.465132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.465948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 784/1581] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:03 2022] PUT /identity/v3/projects/1aa7cb99f3b44a85b984b80ad08e17c5/users/c31a0c08c7a249caadd609a3e772c1c2/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:03.466904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.496157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.497273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 798/1582] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.498455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.531882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ce1d-db27-408b-8ff2-be1bd3c9213d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.539797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.563205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e728-550b-4376-a866-fb1d3c967145 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.567925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.568569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.568933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.569207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.569864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.571844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.588894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.589505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.589792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.590078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.590694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.592602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.593966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 799/1583] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.594780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.604283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766178f-7b2f-43ee-800f-3a6bdec66722 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.609484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.610142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.610454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.610769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.611581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.613203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.616409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 785/1584] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.619604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.624512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 800/1585] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.625242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.632311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623df23-d0b5-4fd2-a91f-7f6af9aab8c6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.636022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f334e-99e5-4eb8-b244-b061d940b6fe admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.637026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.637833 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.638137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.638411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.639039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.640579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2f8d-97d5-4bdb-8197-c5f8771c4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.640990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.641172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2f8d-97d5-4bdb-8197-c5f8771c4f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.641452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2f8d-97d5-4bdb-8197-c5f8771c4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.641726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2f8d-97d5-4bdb-8197-c5f8771c4f65 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.642383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2f8d-97d5-4bdb-8197-c5f8771c4f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.644283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2f8d-97d5-4bdb-8197-c5f8771c4f65 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.666395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 786/1586] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.667324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.667838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 801/1587] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.669079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.669452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.669622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.688641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:03.689900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.697993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 802/1588] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:03.698653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.708439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c2739-5070-4a58-a10a-a4c77649dd9d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.713368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.714021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.714299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.714565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.715208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.717163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.730811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8321-9284-42d9-a2d4-d21eefb192be admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.734683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.735336 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.735744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.736058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.740811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 803/1589] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:03 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:03.742649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.753274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1f7f7-ad47-434a-8645-bf64ce64443d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.758094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.758686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.758963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.759234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.759868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.761491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.772259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 804/1590] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.775462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.783104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7bfbe-7aee-42e1-b52f-398cc3a60696 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.788393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.788988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.789267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.789541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.790201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.791797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.797986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.799462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.802056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 805/1591] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.802832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.805323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.811465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 787/1592] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:03.812366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.813318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce2cfe-aef8-4dd0-accc-425a69e67b5c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.818126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.818876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.819160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.819432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] PATH_INFO: `/v3/projects/58c7f3d0edda4be199d24ded8c59810a/users/459c4ce596c84ec79280e40a14585183/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.824625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff467-23fb-4013-a482-faab9e72e797 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.832485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.833333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.833819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.834153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.835222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.837224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.837389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7f3d0edda4be199d24ded8c59810a, user_id=459c4ce596c84ec79280e40a14585183, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.844729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.848407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 788/1593] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.849307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.859028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 806/1594] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:03 2022] PUT /identity/v3/projects/58c7f3d0edda4be199d24ded8c59810a/users/459c4ce596c84ec79280e40a14585183/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:03.859869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.862715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc3869-0efb-4198-91bf-4b338b6f8a7d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.868480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.930755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc43a5-eb1f-4e28-8bde-224ef63aa25e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.933653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.934308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.934768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.934996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.935262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.935772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.936054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.936325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.936426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.938831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.945950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.947405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.950348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 789/1595] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.954256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.959687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 807/1596] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:03.961241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.965482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae0345-9f1e-4e95-b8ba-f06919f7454d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.971663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.972274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.972637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.972812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.973453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.973862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0f23-8b93-487f-9f6c-2930663293fa service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.975288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.979796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.980982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.980982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.981516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.982969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.985153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.989024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 790/1597] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:03.990140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.001917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61904c32-56a9-4459-a7a2-2d439eddc14d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.005957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 808/1598] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:04.007122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.007960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456b2f-87c5-499f-a74f-5943fb967c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.008889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456b2f-87c5-499f-a74f-5943fb967c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.009168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456b2f-87c5-499f-a74f-5943fb967c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.009435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456b2f-87c5-499f-a74f-5943fb967c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.010244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08456b2f-87c5-499f-a74f-5943fb967c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.012106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08456b2f-87c5-499f-a74f-5943fb967c95 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.020214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732fe9-6db6-4fb1-96b7-c34f7375af63 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.024086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 791/1599] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:04.025449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.025729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.026023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.026211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.027366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.027805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.028239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.029041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.030901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.042300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 809/1600] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:04.043625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.054713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b666f84-b77d-4868-a1d9-e1048331876b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.060901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.061926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.062512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.062983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.063893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] MFA Rules not processed for user `459c4ce596c84ec79280e40a14585183`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:04.064215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.065270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.067031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.070116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:04.082628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 810/1601] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:04.087332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.098790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1517cf-4113-4952-8099-d863e44183f4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.105329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.105981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.106257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.106528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.107597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.109221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.120676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 811/1602] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:04.121670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.132496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f663d5-5460-4bcc-a1c6-e04ffd26a8fc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.138774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.139441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.139716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.139989 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] PATH_INFO: `/v3/projects/3aabb02cf14541f997b08fe0853acac0/users/3dc4ac4ada004bbb942c36755f4a7cd1/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.158451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aabb02cf14541f997b08fe0853acac0, user_id=3dc4ac4ada004bbb942c36755f4a7cd1, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.162319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.163264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 792/1603] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:04.164278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.178203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02369b-86bd-4ad2-8004-0638607e1b83 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.191148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 812/1604] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:04 2022] PUT /identity/v3/projects/3aabb02cf14541f997b08fe0853acac0/users/3dc4ac4ada004bbb942c36755f4a7cd1/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.191148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.245652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:04.260498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.261570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.262380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.263060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] PATH_INFO: `/v3/projects/7c3039f002ef448b99d4e7f484055fd7/users/73f1b9e32ad3493284c5df45afd042fa/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.274417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0c0b-1387-47cc-b083-21fc92a9a0ba admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.280006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.280913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.281196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.281728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] PATH_INFO: `/v3/projects/dd581788f9ca4c2fb1ba3fe02f34b29d/users/cbb16c0b86444a59ab299013c694cb07/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.282466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3039f002ef448b99d4e7f484055fd7, user_id=73f1b9e32ad3493284c5df45afd042fa, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.285964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.301008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd581788f9ca4c2fb1ba3fe02f34b29d, user_id=cbb16c0b86444a59ab299013c694cb07, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.304333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.308432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 793/1605] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:04 2022] PUT /identity/v3/projects/7c3039f002ef448b99d4e7f484055fd7/users/73f1b9e32ad3493284c5df45afd042fa/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.309559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.326779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 813/1606] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:04 2022] PUT /identity/v3/projects/dd581788f9ca4c2fb1ba3fe02f34b29d/users/cbb16c0b86444a59ab299013c694cb07/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.327608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.452930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db68fa9-b15f-4acc-9ece-efe9f17e8036 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.476270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61b4c1-470c-4dd7-a188-b448b6d8b952 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.481364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.481961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.482241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.482512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] PATH_INFO: `/v3/projects/28d43c7790a9441c9cca6cb9127d5f51/users/3a08cba5a7d24945ada0a2ce56d70805/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.505001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d43c7790a9441c9cca6cb9127d5f51, user_id=3a08cba5a7d24945ada0a2ce56d70805, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.507951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.525624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 814/1607] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:04 2022] PUT /identity/v3/projects/28d43c7790a9441c9cca6cb9127d5f51/users/3a08cba5a7d24945ada0a2ce56d70805/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.529794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.542662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343b31f-ce3f-439e-b86e-9e4671b4dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.543357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343b31f-ce3f-439e-b86e-9e4671b4dc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.543629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343b31f-ce3f-439e-b86e-9e4671b4dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.543895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343b31f-ce3f-439e-b86e-9e4671b4dc94 admin admin] PATH_INFO: `/v3/projects/65db563016794cacbf33fa984d7f80db/users/5510f78afb8249a2b9d9a89645135345/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.569054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343b31f-ce3f-439e-b86e-9e4671b4dc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65db563016794cacbf33fa984d7f80db, user_id=5510f78afb8249a2b9d9a89645135345, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.573862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343b31f-ce3f-439e-b86e-9e4671b4dc94 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.601520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:04.614179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 794/1608] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:04 2022] PUT /identity/v3/projects/65db563016794cacbf33fa984d7f80db/users/5510f78afb8249a2b9d9a89645135345/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.614179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c6742-bca0-4efd-9a72-ee0bb5cc4d8a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.614179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c6742-bca0-4efd-9a72-ee0bb5cc4d8a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.614179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c6742-bca0-4efd-9a72-ee0bb5cc4d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.647118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9d3c6742-bca0-4efd-9a72-ee0bb5cc4d8a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:04.649378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9d3c6742-bca0-4efd-9a72-ee0bb5cc4d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.653500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5462-d8e6-48d3-86cd-c9e662cfd200 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.716948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd9654-7976-493c-9ab0-96702b5ec8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.717571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd9654-7976-493c-9ab0-96702b5ec8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.717907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd9654-7976-493c-9ab0-96702b5ec8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.718182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd9654-7976-493c-9ab0-96702b5ec8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.718824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd9654-7976-493c-9ab0-96702b5ec8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.722271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 795/1609] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:04.722271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50844c12-f0af-43a6-be3b-7ab60ee719eb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.722271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50844c12-f0af-43a6-be3b-7ab60ee719eb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.722675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd9654-7976-493c-9ab0-96702b5ec8ea admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.723223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50844c12-f0af-43a6-be3b-7ab60ee719eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.738356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:04.745263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-50844c12-f0af-43a6-be3b-7ab60ee719eb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:04.747275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-50844c12-f0af-43a6-be3b-7ab60ee719eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.755397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 796/1610] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:04.757134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d77491-74ec-46a6-bd95-861559b7852d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.757578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d77491-74ec-46a6-bd95-861559b7852d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.758014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d77491-74ec-46a6-bd95-861559b7852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.767952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 815/1611] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/projects => generated 409 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:04.767952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.767952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.767952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.789136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d4d77491-74ec-46a6-bd95-861559b7852d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:04.790564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d4d77491-74ec-46a6-bd95-861559b7852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.797352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] MFA Rules not processed for user `3a08cba5a7d24945ada0a2ce56d70805`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:04.798585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.877972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 797/1612] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:04.879584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.879871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.880144 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.900387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 816/1613] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:04.901400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.915387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] MFA Rules not processed for user `5510f78afb8249a2b9d9a89645135345`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:04.917210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.966989 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560dc55-4f1a-4503-b1ce-e7d77de8a73b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.971802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.972940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.973415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.973908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.983824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:04.990024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.993545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.004325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 798/1614] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:05.004898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 817/1615] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:05.005721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.006085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.015376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534a721-9d6c-4488-b759-b61f67b1f5d0 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.019235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f92c-0548-42a1-8b10-948c3f1ed89a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.020658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.021399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.021792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.022254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.025990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.026692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.026971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.027375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.027995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.030617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.034704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.036751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.051482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 818/1616] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:05.052711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.063710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 799/1617] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/users => generated 311 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:05.064679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.066958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae1896-9c6e-4721-a911-d35c78cf7bd2 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.079959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32605c-3b50-4abb-9df4-aa72dea7baf7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.082075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dc7e3-ac61-4337-8974-f01ecdb38662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.082783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc7e3-ac61-4337-8974-f01ecdb38662 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.083148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc7e3-ac61-4337-8974-f01ecdb38662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.083364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dc7e3-ac61-4337-8974-f01ecdb38662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.092170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7967-938f-4fd3-9072-0d5490c845de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.092807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7967-938f-4fd3-9072-0d5490c845de admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.093059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7967-938f-4fd3-9072-0d5490c845de admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.093325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7967-938f-4fd3-9072-0d5490c845de admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.094100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7967-938f-4fd3-9072-0d5490c845de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.100298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dc7e3-ac61-4337-8974-f01ecdb38662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.101176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7967-938f-4fd3-9072-0d5490c845de admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.101805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70dc7e3-ac61-4337-8974-f01ecdb38662 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.116843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 819/1618] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:05.119303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69708d27-15ec-4900-b107-0e3a40ef9aca None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.120381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69708d27-15ec-4900-b107-0e3a40ef9aca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.120865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69708d27-15ec-4900-b107-0e3a40ef9aca None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.123689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 820/1619] 10.222.0.75 () {54 vars in 962 bytes} [Wed Aug 31 10:54:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:05.124713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69708d27-15ec-4900-b107-0e3a40ef9aca None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.151334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69708d27-15ec-4900-b107-0e3a40ef9aca None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.153940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 800/1620] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:05.155593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.155932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.156255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.207840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:05.209095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:05.244826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.245825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.246181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.246554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.247375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.249622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.251924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.265505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 821/1621] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:05.265505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.275262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113369a-7999-4f8c-a97c-b1a367276135 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.280280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.281039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.281477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.281875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.282742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.285083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.300540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 801/1622] 10.222.0.75 () {58 vars in 1059 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:05.320128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.322358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 822/1623] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/users => generated 295 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:05.325194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.335311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd53c5e-572c-444e-bc31-4e5b1c2c843f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.343528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.345014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.345280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.345555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] PATH_INFO: `/v3/projects/5148d1159e4a43b7932bd7513dd43be5/users/68d4c26a44ac4fd08674c7a2ef528b40/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.352721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fcd1e-458d-47ef-89a4-d8c0b4ff1263 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.359768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.360641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.360984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.361702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.368531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5148d1159e4a43b7932bd7513dd43be5, user_id=68d4c26a44ac4fd08674c7a2ef528b40, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.371321 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.391074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 802/1624] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:05 2022] PUT /identity/v3/projects/5148d1159e4a43b7932bd7513dd43be5/users/68d4c26a44ac4fd08674c7a2ef528b40/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:05.395999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.435744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.437902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.459664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 823/1625] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:05.460550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.472471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f680a7-d8db-4d06-a171-3c146eb271d9 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.478077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1af2e-5d4d-4efc-86e7-e9ce8d6f69c5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.478957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.481681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.482087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.482468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.483582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.484094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.485033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.485501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.486106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.486506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.487223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.489483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.499004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 824/1626] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:05.502869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.510424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 803/1627] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:05.513223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.528275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab95fd-4625-4030-882c-e870fa318c30 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.533422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc2be7-137b-4104-b1e5-7b804b42c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.534123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2be7-137b-4104-b1e5-7b804b42c4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.534402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2be7-137b-4104-b1e5-7b804b42c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.534677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2be7-137b-4104-b1e5-7b804b42c4dd admin admin] PATH_INFO: `/v3/projects/5148d1159e4a43b7932bd7513dd43be5/users/68d4c26a44ac4fd08674c7a2ef528b40/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.534957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de623f9b-1b52-4eac-b575-59edffabf965 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.546731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.547221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2be7-137b-4104-b1e5-7b804b42c4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5148d1159e4a43b7932bd7513dd43be5, user_id=68d4c26a44ac4fd08674c7a2ef528b40, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.548284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.549371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.549917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] PATH_INFO: `/v3/projects/4e59266b765f466b91edc2c04d1fb613/users/4613cfb8e7bd4feba0311f6001149ac5/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.550042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2be7-137b-4104-b1e5-7b804b42c4dd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.577401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e59266b765f466b91edc2c04d1fb613, user_id=4613cfb8e7bd4feba0311f6001149ac5, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.581547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.592545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 825/1628] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:05 2022] PUT /identity/v3/projects/5148d1159e4a43b7932bd7513dd43be5/users/68d4c26a44ac4fd08674c7a2ef528b40/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:05.593452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.593823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.594160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.615431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 804/1629] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:05 2022] PUT /identity/v3/projects/4e59266b765f466b91edc2c04d1fb613/users/4613cfb8e7bd4feba0311f6001149ac5/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:05.616319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.686517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] MFA Rules not processed for user `68d4c26a44ac4fd08674c7a2ef528b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:05.687814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:05.709309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.801319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d614c-0515-4641-893c-a3a8806481b7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.816942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.820883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.821390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.821900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.824304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.825537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 826/1630] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:05.827097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.837020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.858864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 805/1631] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:05.860887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.875047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a447-d0bd-4cca-b78c-730fd69cd509 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.886754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1a834-c0b6-4977-8a5d-bd0f103b8830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.887656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1a834-c0b6-4977-8a5d-bd0f103b8830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.900871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1a834-c0b6-4977-8a5d-bd0f103b8830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.901153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1a834-c0b6-4977-8a5d-bd0f103b8830 admin admin] PATH_INFO: `/v3/projects/4e59266b765f466b91edc2c04d1fb613/users/4613cfb8e7bd4feba0311f6001149ac5/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.906420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1a834-c0b6-4977-8a5d-bd0f103b8830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e59266b765f466b91edc2c04d1fb613, user_id=4613cfb8e7bd4feba0311f6001149ac5, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.910432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1a834-c0b6-4977-8a5d-bd0f103b8830 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.921033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.928796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 806/1632] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:05 2022] PUT /identity/v3/projects/4e59266b765f466b91edc2c04d1fb613/users/4613cfb8e7bd4feba0311f6001149ac5/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:05.940613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd5e34-73f5-4677-904e-3456d4b95171 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.940959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd5e34-73f5-4677-904e-3456d4b95171 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.941410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd5e34-73f5-4677-904e-3456d4b95171 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.943030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 807/1633] 10.222.0.75 () {54 vars in 912 bytes} [Wed Aug 31 10:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:05.944110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5214-67e8-4e2a-9343-c974aec61aca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.944439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5214-67e8-4e2a-9343-c974aec61aca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.944782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5214-67e8-4e2a-9343-c974aec61aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.966752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e31a46-5ed4-46d1-8199-1c11526262ca None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.986492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-85ae5214-67e8-4e2a-9343-c974aec61aca None None] MFA Rules not processed for user `4613cfb8e7bd4feba0311f6001149ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:05.988176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85ae5214-67e8-4e2a-9343-c974aec61aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.060832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.061569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.061948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.062291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.111505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 808/1634] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.113416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20703ddc-4c7d-4cb8-a926-e7d178fec715 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.113670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20703ddc-4c7d-4cb8-a926-e7d178fec715 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.114003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20703ddc-4c7d-4cb8-a926-e7d178fec715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.198641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-20703ddc-4c7d-4cb8-a926-e7d178fec715 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.198641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-20703ddc-4c7d-4cb8-a926-e7d178fec715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.251622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.254227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.266631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 827/1635] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:06.266837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 809/1636] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.267409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.268306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35909e2-8417-4833-80c0-30e15dac1fbd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.268657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35909e2-8417-4833-80c0-30e15dac1fbd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.269164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35909e2-8417-4833-80c0-30e15dac1fbd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.276575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2269e-b5ef-4484-b351-c204dc4907bf service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.276814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 810/1637] 10.222.0.75 () {54 vars in 962 bytes} [Wed Aug 31 10:54:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:06.278780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9573-b510-4b47-bf44-42be200c663d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.278937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9573-b510-4b47-bf44-42be200c663d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.279851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9573-b510-4b47-bf44-42be200c663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.281032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.281671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.282002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.282278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.293887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.315986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a71c9573-b510-4b47-bf44-42be200c663d None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.317414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a71c9573-b510-4b47-bf44-42be200c663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.335309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 811/1638] 10.222.0.75 () {58 vars in 1059 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.336958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f1df7-8d8b-40c0-92ac-7bbcce6a4658 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.337242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f1df7-8d8b-40c0-92ac-7bbcce6a4658 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.337516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f1df7-8d8b-40c0-92ac-7bbcce6a4658 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.345507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 812/1639] 10.222.0.75 () {54 vars in 912 bytes} [Wed Aug 31 10:54:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:06.347234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.347520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.347916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.356242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.357723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.373521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 828/1640] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:06.377120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.379067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.384518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.395828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc1ac1-d145-42ee-a773-eb862ab527fd service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.398842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 813/1641] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:06.400110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.401062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.401412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.401871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.417698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.420036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.433710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 829/1642] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:06.884868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.896931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe81e-83c2-41d0-a3f4-6834b4b2e77d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.901150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.901904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.902273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.902625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.923306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.924976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.942295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 814/1643] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:07.016877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:07.029753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fda3-cd6a-46d3-b3b9-c4b9d2dd8777 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.034848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e66527-1926-4afd-9597-dae8d593cd21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.035756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66527-1926-4afd-9597-dae8d593cd21 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.036206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66527-1926-4afd-9597-dae8d593cd21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.036628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66527-1926-4afd-9597-dae8d593cd21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.116440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e66527-1926-4afd-9597-dae8d593cd21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.118357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e66527-1926-4afd-9597-dae8d593cd21 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.154262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 830/1644] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:12.476281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.492648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847594-2c0e-405d-bb24-27e664c0fbb5 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.497188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecfc07-99d3-42ba-bd34-d616ed492e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.498222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecfc07-99d3-42ba-bd34-d616ed492e8b service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.498689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecfc07-99d3-42ba-bd34-d616ed492e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.501917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecfc07-99d3-42ba-bd34-d616ed492e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.527376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecfc07-99d3-42ba-bd34-d616ed492e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.529057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecfc07-99d3-42ba-bd34-d616ed492e8b service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.566361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 815/1645] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:15.270299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.270824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.270998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.327021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] MFA Rules not processed for user `c31a0c08c7a249caadd609a3e772c1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:15.329404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.413650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 831/1646] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:15.415261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422741d-c065-495d-af1e-66879fd529f7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.415728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422741d-c065-495d-af1e-66879fd529f7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.415806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422741d-c065-495d-af1e-66879fd529f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.458970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1422741d-c065-495d-af1e-66879fd529f7 None None] MFA Rules not processed for user `c31a0c08c7a249caadd609a3e772c1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:15.460330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1422741d-c065-495d-af1e-66879fd529f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.467688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 816/1647] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:15.484525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.510242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befd8d5-d777-4f63-a007-958083f1cf97 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.526049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.527010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.528933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.529329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.544443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.547125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.578051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 832/1648] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:15.747709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8cfc-41fb-46ba-9828-5a049ded1dc4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.747991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8cfc-41fb-46ba-9828-5a049ded1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.748263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8cfc-41fb-46ba-9828-5a049ded1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.805030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-801b8cfc-41fb-46ba-9828-5a049ded1dc4 None None] MFA Rules not processed for user `cbb16c0b86444a59ab299013c694cb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:15.806260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-801b8cfc-41fb-46ba-9828-5a049ded1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.890259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:16.017935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 817/1649] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:16.032001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:16.052952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b283-f3ba-4e8b-abb7-932506cf3dc9 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:16.069097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5e005-3408-4eb8-880a-023a34e473d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:16.069729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5e005-3408-4eb8-880a-023a34e473d7 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.070034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5e005-3408-4eb8-880a-023a34e473d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.071025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5e005-3408-4eb8-880a-023a34e473d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.099806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5e005-3408-4eb8-880a-023a34e473d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:16.101988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5e005-3408-4eb8-880a-023a34e473d7 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:16.106413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:16.143350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 833/1650] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:16.692327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0f2ba-2c0f-4c74-87d3-ad6f6165e3a4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.692850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0f2ba-2c0f-4c74-87d3-ad6f6165e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.693459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0f2ba-2c0f-4c74-87d3-ad6f6165e3a4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.696469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 818/1651] 10.222.0.75 () {54 vars in 912 bytes} [Wed Aug 31 10:54:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:16.703112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.704469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.704955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.840359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:16.842991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:17.015050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 834/1652] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:17.075774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0f2ba-2c0f-4c74-87d3-ad6f6165e3a4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.104925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0f2ba-2c0f-4c74-87d3-ad6f6165e3a4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.133132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3683e5-1ffd-4bf8-b930-3504372e6cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.133675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3683e5-1ffd-4bf8-b930-3504372e6cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.133984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3683e5-1ffd-4bf8-b930-3504372e6cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.134256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3683e5-1ffd-4bf8-b930-3504372e6cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.173468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3683e5-1ffd-4bf8-b930-3504372e6cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.174999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3683e5-1ffd-4bf8-b930-3504372e6cc6 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.218188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 819/1653] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:18.742269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.989150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d9554-1078-411f-8b5c-88bb24392b5e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.024934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.026699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.026851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.027022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.047909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.049580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071185c-a3ce-44cc-979d-bfd4f773c777 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.050488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071185c-a3ce-44cc-979d-bfd4f773c777 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.051046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071185c-a3ce-44cc-979d-bfd4f773c777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.070678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.072732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.105327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 835/1654] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:19.106721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.128779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e071185c-a3ce-44cc-979d-bfd4f773c777 None None] MFA Rules not processed for user `3dc4ac4ada004bbb942c36755f4a7cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.131747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e071185c-a3ce-44cc-979d-bfd4f773c777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.341472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7d79-951d-49ce-a412-1b665ade2df2 service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.342247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 820/1655] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:19.346939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.348627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.349064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.361320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.365341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.367087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.367834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] PATH_INFO: `/v3/users/5510f78afb8249a2b9d9a89645135345` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.371125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5510f78afb8249a2b9d9a89645135345)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.381314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.401261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] MFA Rules not processed for user `3dc4ac4ada004bbb942c36755f4a7cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.404601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.427445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 821/1656] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:19.439707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.483447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:19.489935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395b4d7-4aca-41e9-8fde-de2c4d806a87 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.498560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b35fa-9044-4d3f-854d-be423ddc4840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.499490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b35fa-9044-4d3f-854d-be423ddc4840 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.499983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b35fa-9044-4d3f-854d-be423ddc4840 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.500513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b35fa-9044-4d3f-854d-be423ddc4840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.522428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b35fa-9044-4d3f-854d-be423ddc4840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.524181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b35fa-9044-4d3f-854d-be423ddc4840 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.526536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5510f78afb8249a2b9d9a89645135345'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.527675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5510f78afb8249a2b9d9a89645135345'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.545608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5510f78afb8249a2b9d9a89645135345'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.548057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5510f78afb8249a2b9d9a89645135345'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.554918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 822/1657] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:19.576362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5510f78afb8249a2b9d9a89645135345'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.628394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 836/1658] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:19 2022] DELETE /identity/v3/users/5510f78afb8249a2b9d9a89645135345 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:19.633418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116691-2b51-4487-81bd-aefebe421594 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.634187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116691-2b51-4487-81bd-aefebe421594 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.635537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116691-2b51-4487-81bd-aefebe421594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.692072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5b116691-2b51-4487-81bd-aefebe421594 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.700761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5b116691-2b51-4487-81bd-aefebe421594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.907204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 823/1659] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:20.011821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.014451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:20.191671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965da2-f464-4ce3-9b5c-2ff9f9a509d5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.200143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.201063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.201553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.202151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.230976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.232760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.260849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 837/1660] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:20.935754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d81975-7ad4-41bb-8cd5-0766799dad67 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.936226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d81975-7ad4-41bb-8cd5-0766799dad67 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.936298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d81975-7ad4-41bb-8cd5-0766799dad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.010440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-24d81975-7ad4-41bb-8cd5-0766799dad67 None None] MFA Rules not processed for user `3dc4ac4ada004bbb942c36755f4a7cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:21.013584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24d81975-7ad4-41bb-8cd5-0766799dad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.081027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:21.125044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:21.126578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.152106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa6da-896a-4d57-8631-4872f7c15ed8 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:21.161039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:21.161713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.163187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.163465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] PATH_INFO: `/v3/users/459c4ce596c84ec79280e40a14585183` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.166821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459c4ce596c84ec79280e40a14585183)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:21.169740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:21.276080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 824/1661] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:21.294564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459c4ce596c84ec79280e40a14585183'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:21.295526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459c4ce596c84ec79280e40a14585183'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:21.309188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459c4ce596c84ec79280e40a14585183'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:21.310422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459c4ce596c84ec79280e40a14585183'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:21.331963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8a335842-91ac-4eb7-9feb-f8ebb50c5787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459c4ce596c84ec79280e40a14585183'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:21.368746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 838/1662] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:21 2022] DELETE /identity/v3/users/459c4ce596c84ec79280e40a14585183 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:21.377095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.377435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.377715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.382961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.383238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.384703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.435213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:21.436475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.480713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] MFA Rules not processed for user `73f1b9e32ad3493284c5df45afd042fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:21.490043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.500450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:21.715587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 825/1663] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:21.758100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 839/1664] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:21.802036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:21.803551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.945453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79914-dc9c-496b-a234-5201d2f3aafb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:21.977360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:21.978050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.978327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.978829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:22.003621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:22.010265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:22.050034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 826/1665] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:22.175092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:22.176551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:22.301473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71ddbd-91b6-45cf-a7c3-7b657a94e41b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:22.310640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36325570-30db-4c1d-92f7-e40deb2e594c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:22.311622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36325570-30db-4c1d-92f7-e40deb2e594c service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:22.312092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36325570-30db-4c1d-92f7-e40deb2e594c service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:22.312564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36325570-30db-4c1d-92f7-e40deb2e594c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:22.331256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36325570-30db-4c1d-92f7-e40deb2e594c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:22.340802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36325570-30db-4c1d-92f7-e40deb2e594c service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:22.364031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 840/1666] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:22.821950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:22.823452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:22.863905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543b56-17c1-4724-954a-3c364db1175f service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:22.869520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:22.871139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:22.871968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:22.872586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] PATH_INFO: `/v3/projects/65db563016794cacbf33fa984d7f80db` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:22.874483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65db563016794cacbf33fa984d7f80db)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:22.883546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:22.965246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65db563016794cacbf33fa984d7f80db', 'request_id': 'req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:22.974883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65db563016794cacbf33fa984d7f80db', 'request_id': 'req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:22.987852 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65db563016794cacbf33fa984d7f80db', 'request_id': 'req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:22.991007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:23.020228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] The token cache is being invalidate because project 65db563016794cacbf33fa984d7f80db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:23.020228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.020228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c26eca96-9e5b-4ba4-84ff-c8a2141090a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.026081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.026081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.026081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.033255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 827/1667] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:22 2022] DELETE /identity/v3/projects/65db563016794cacbf33fa984d7f80db => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:23.049037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:23.055077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.165377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.165618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 841/1668] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:23.165726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.166001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.203301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:23.204565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.227895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 828/1669] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:23.230737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.255130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2081181-f3b1-44d5-9cc5-6db5ef348385 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.269437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.274497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.275376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.276453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.277996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:23.282280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.284124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.326572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 842/1670] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:23.331247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.347150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c8d1-397c-4e24-9a5b-329dd15910ea None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.356654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb684-9627-4733-a813-039a99c711d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.357296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb684-9627-4733-a813-039a99c711d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.357746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb684-9627-4733-a813-039a99c711d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.358220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb684-9627-4733-a813-039a99c711d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.361611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb684-9627-4733-a813-039a99c711d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.365840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb684-9627-4733-a813-039a99c711d3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.447530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 829/1671] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:23.452026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.468568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617b366-29b7-4e05-9d28-6777d3d77467 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.539133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:23.694015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.695093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.695433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.701002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.701986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.702272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.702614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.703393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.708232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.725488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] MFA Rules not processed for user `cbb16c0b86444a59ab299013c694cb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:23.727090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.775745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 843/1672] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:23.776922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.810599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583f41a-88e8-4b16-8c73-292b8988ffc2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.823477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.825337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.835872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.838917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.846097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.853079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.855690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 830/1673] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:23.876151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 844/1674] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:23.883291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.919253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc841-2623-4ab2-bc51-159cc961fa97 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.924748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.925463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.925797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.926512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.928630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.931193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.966129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 831/1675] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:23.970229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.986006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.988296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.988413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86fda3-b5c0-4ebf-97c5-63af1df97471 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.001144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2138-9f69-4f32-a521-e4447d525c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.002847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2138-9f69-4f32-a521-e4447d525c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.004279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2138-9f69-4f32-a521-e4447d525c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.004613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2138-9f69-4f32-a521-e4447d525c14 admin admin] PATH_INFO: `/v3/projects/f2f2666fd0aa47c4b84a20fcb6c6da25/users/66b988cd9c3940bc91b784d14d45dd34/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.052654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3294b0-9f0d-4f54-8192-b7a6f1d1dfb2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.053689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f2138-9f69-4f32-a521-e4447d525c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f2666fd0aa47c4b84a20fcb6c6da25, user_id=66b988cd9c3940bc91b784d14d45dd34, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.063366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f2138-9f69-4f32-a521-e4447d525c14 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.081623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.094154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.094435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.094705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] PATH_INFO: `/v3/projects/58c7f3d0edda4be199d24ded8c59810a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.106009 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c7f3d0edda4be199d24ded8c59810a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.113591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.118474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 845/1676] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:23 2022] PUT /identity/v3/projects/f2f2666fd0aa47c4b84a20fcb6c6da25/users/66b988cd9c3940bc91b784d14d45dd34/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:24.129455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.130072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.130072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.221661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] MFA Rules not processed for user `66b988cd9c3940bc91b784d14d45dd34`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:24.223297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.348839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c7f3d0edda4be199d24ded8c59810a', 'request_id': 'req-00a519d8-1f73-4fb7-bff4-076ede9dc338'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.377182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c7f3d0edda4be199d24ded8c59810a', 'request_id': 'req-00a519d8-1f73-4fb7-bff4-076ede9dc338'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.405890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c7f3d0edda4be199d24ded8c59810a', 'request_id': 'req-00a519d8-1f73-4fb7-bff4-076ede9dc338'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.421080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 846/1677] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:24.425007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:24.431084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.443198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] The token cache is being invalidate because project 58c7f3d0edda4be199d24ded8c59810a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:24.443504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.444536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.448970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 832/1678] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:23 2022] DELETE /identity/v3/projects/58c7f3d0edda4be199d24ded8c59810a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:24.452408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:24.453934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.652067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede610b6-fb65-4283-a4bd-f23df5741aa8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.665309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:24.671838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:24.740786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a519d8-1f73-4fb7-bff4-076ede9dc338 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.753121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.753464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.753847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.754210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] PATH_INFO: `/v3/users/e44d3f7f4e0a411fa2416ae5f466eabb` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.755437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44d3f7f4e0a411fa2416ae5f466eabb)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.759710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.767412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.768540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.769062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.770577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.773475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.775102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.878027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 833/1679] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:24 2022] POST /identity/v3/projects => generated 365 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:24.879960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:24.892057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.945995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44d3f7f4e0a411fa2416ae5f466eabb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.946604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44d3f7f4e0a411fa2416ae5f466eabb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.971991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44d3f7f4e0a411fa2416ae5f466eabb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.978482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44d3f7f4e0a411fa2416ae5f466eabb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.005973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ad4f9d83-9448-4583-952e-7dc18a681572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44d3f7f4e0a411fa2416ae5f466eabb'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.041703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 847/1680] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:24 2022] DELETE /identity/v3/users/e44d3f7f4e0a411fa2416ae5f466eabb => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:25.042933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac28141-cb80-4548-b4a4-babc697a3f6b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.043361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac28141-cb80-4548-b4a4-babc697a3f6b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.043712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac28141-cb80-4548-b4a4-babc697a3f6b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.045112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 848/1681] 10.222.0.75 () {54 vars in 912 bytes} [Wed Aug 31 10:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:25.045671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac28141-cb80-4548-b4a4-babc697a3f6b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.052517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bac28141-cb80-4548-b4a4-babc697a3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.090033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499364ad-c81c-45fc-9836-b4da5bfc6bce admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.211154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac28141-cb80-4548-b4a4-babc697a3f6b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.219768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.220217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.221451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.221451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] PATH_INFO: `/v3/users/68d4c26a44ac4fd08674c7a2ef528b40` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.225839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d4c26a44ac4fd08674c7a2ef528b40)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.230586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: WARNING py.warnings [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:54:25.230586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:54:25.230586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: Aug 31 10:54:25.231787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8b8c9-4ea1-41ab-bdcf-5b447c5ea913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.232324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.232426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b8c9-4ea1-41ab-bdcf-5b447c5ea913 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.232685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b8c9-4ea1-41ab-bdcf-5b447c5ea913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.233027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b8c9-4ea1-41ab-bdcf-5b447c5ea913 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.233580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8b8c9-4ea1-41ab-bdcf-5b447c5ea913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.238273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8b8c9-4ea1-41ab-bdcf-5b447c5ea913 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.318716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 849/1682] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:25 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:25.320506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7d68-0589-49a1-82a7-c272e57d23dc None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.321129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7d68-0589-49a1-82a7-c272e57d23dc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.323180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7d68-0589-49a1-82a7-c272e57d23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.354533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2a6f7d68-0589-49a1-82a7-c272e57d23dc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:25.356066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a6f7d68-0589-49a1-82a7-c272e57d23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.364797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 850/1683] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:25.366510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.366796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.367070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.396989 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:25.399041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.399355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d4c26a44ac4fd08674c7a2ef528b40'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.411157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:25.422943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d4c26a44ac4fd08674c7a2ef528b40'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.424317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d4c26a44ac4fd08674c7a2ef528b40'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.458049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d4c26a44ac4fd08674c7a2ef528b40'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.459022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d4c26a44ac4fd08674c7a2ef528b40'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.461217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:25.481711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 851/1684] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:25.482655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.483668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 834/1685] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:24 2022] DELETE /identity/v3/users/68d4c26a44ac4fd08674c7a2ef528b40 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:25.484568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.486468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.491087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.525995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2af3-462f-4a2c-9d9d-77b16bd76c35 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.651020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb93be-3670-410f-9484-70a7ebe26159 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.660234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.661035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.661318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.661581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.666819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.694992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.695709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.697200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.697513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.699413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.704402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.717152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 852/1686] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:25.718327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.721034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.772608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990bf16-1f1f-4b43-a352-cb4e30a9c707 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.783429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.784359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.784781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.785203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.801032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.802956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.818929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.822892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bf006-4724-4c2c-9f90-abc476e8b5c7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.831370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 853/1687] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:25.832935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.884363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17894d32-baeb-4654-bc67-cae14cd38f76 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.888322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 835/1688] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:25.920872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.929312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.931441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.934030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] PATH_INFO: `/v3/projects/6852a524465c426098a4b931baf50605/users/e7aafb2e8e504cb8bd89cec6aa3bf968/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.957419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf253fc-b491-4989-8427-4e385166c222 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.957756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf253fc-b491-4989-8427-4e385166c222 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.958059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf253fc-b491-4989-8427-4e385166c222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.985860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6852a524465c426098a4b931baf50605, user_id=e7aafb2e8e504cb8bd89cec6aa3bf968, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.989153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.024116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 854/1689] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:25 2022] PUT /identity/v3/projects/6852a524465c426098a4b931baf50605/users/e7aafb2e8e504cb8bd89cec6aa3bf968/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:26.030694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.101788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5bf253fc-b491-4989-8427-4e385166c222 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:26.103044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5bf253fc-b491-4989-8427-4e385166c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.250688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01b97-118d-4f9c-b60d-d6e14405334e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.293470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.296611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.296894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.297170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.306269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.309995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.355875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 855/1690] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:26.358685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.387741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 836/1691] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:26.409255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec794d5-171a-4e05-b6fa-7244e2fabc68 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.430343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.433965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.434317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.434663 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] PATH_INFO: `/v3/projects/6852a524465c426098a4b931baf50605/users/e7aafb2e8e504cb8bd89cec6aa3bf968/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.448250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6852a524465c426098a4b931baf50605, user_id=e7aafb2e8e504cb8bd89cec6aa3bf968, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.453438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.482798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 856/1692] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:26 2022] PUT /identity/v3/projects/6852a524465c426098a4b931baf50605/users/e7aafb2e8e504cb8bd89cec6aa3bf968/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:26.493075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.493382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.493617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.532006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:26.551979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] MFA Rules not processed for user `e7aafb2e8e504cb8bd89cec6aa3bf968`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:26.553320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.705839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.707667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.716066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:26.732952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 837/1693] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:26.743156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.746503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.946035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce61b2-23f3-43fd-adb3-60aff1ebb871 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.955513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.956409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.956694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.956964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.973023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a447a-1f02-406d-845a-0a58b0c3cb83 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.979993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.989530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc9c4c-8c66-460d-8336-adc851a877a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.990390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc9c4c-8c66-460d-8336-adc851a877a0 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.990805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc9c4c-8c66-460d-8336-adc851a877a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.991279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc9c4c-8c66-460d-8336-adc851a877a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.993387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.022892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 838/1694] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:27.023949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:27.025573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.076190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc9c4c-8c66-460d-8336-adc851a877a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:27.077963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc9c4c-8c66-460d-8336-adc851a877a0 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.089891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 857/1695] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:54:27.252463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78657f61-d5c8-4b2f-8df2-3f2de8954e1e service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:27.274635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:27.277155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.281535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.284732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] PATH_INFO: `/v3/projects/5148d1159e4a43b7932bd7513dd43be5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.288658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5148d1159e4a43b7932bd7513dd43be5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:27.305607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.430281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:27.451177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5148d1159e4a43b7932bd7513dd43be5', 'request_id': 'req-0c1ec708-dd53-42c3-a2a3-d75fc213e450'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.468997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5148d1159e4a43b7932bd7513dd43be5', 'request_id': 'req-0c1ec708-dd53-42c3-a2a3-d75fc213e450'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.487675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5148d1159e4a43b7932bd7513dd43be5', 'request_id': 'req-0c1ec708-dd53-42c3-a2a3-d75fc213e450'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.504341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] The token cache is being invalidate because project 5148d1159e4a43b7932bd7513dd43be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:27.505049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.506280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.508064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 839/1696] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:27 2022] DELETE /identity/v3/projects/5148d1159e4a43b7932bd7513dd43be5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:27.519193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e54b9-ed7a-458c-ad34-59099ee3a2f8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.519800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e54b9-ed7a-458c-ad34-59099ee3a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.519800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e54b9-ed7a-458c-ad34-59099ee3a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.580932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-206e54b9-ed7a-458c-ad34-59099ee3a2f8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:27.590481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-206e54b9-ed7a-458c-ad34-59099ee3a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.805153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:27.807550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.897581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 858/1697] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:27.913162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.913444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.921124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.973814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:27.983681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.018047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 859/1698] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.023595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.041556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ec708-dd53-42c3-a2a3-d75fc213e450 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.042895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7454abb-132f-4cce-b594-8d24283d5f36 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.051770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.052415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.052703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.053080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.053760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:28.054074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.054306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.056701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.057503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.058576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] PATH_INFO: `/v3/projects/92a4742f10394b1cb1698143ac53011d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.064146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.066675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a4742f10394b1cb1698143ac53011d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.080000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.102149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 860/1699] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:28.106751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.136145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf850e-4097-4a8d-8a5d-4f2e4ea0452d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.150702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.151350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.151626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.151899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.152539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.154530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.181377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:28.236078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 861/1700] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:28.241821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a4742f10394b1cb1698143ac53011d', 'request_id': 'req-30d8b641-57ea-4ac2-99ed-d0f2686326a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.242971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.264844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a4742f10394b1cb1698143ac53011d', 'request_id': 'req-30d8b641-57ea-4ac2-99ed-d0f2686326a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.286233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a4742f10394b1cb1698143ac53011d', 'request_id': 'req-30d8b641-57ea-4ac2-99ed-d0f2686326a7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.319987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] The token cache is being invalidate because project 92a4742f10394b1cb1698143ac53011d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:28.320335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.322998 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-30d8b641-57ea-4ac2-99ed-d0f2686326a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.327590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 840/1701] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:27 2022] DELETE /identity/v3/projects/92a4742f10394b1cb1698143ac53011d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:28.332262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.332544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.333080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.442135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.443378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.511198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283415ac-4527-4767-9566-687fe8055e2c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.520977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.521887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.521991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.522223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.522869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.524826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.572878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 862/1702] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/users => generated 290 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:28.573861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.575625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.601719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f23bf4-1875-477f-a5d2-0d57585293d7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.615292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:28.615788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.616456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.616734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.617011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] PATH_INFO: `/v3/users/66b988cd9c3940bc91b784d14d45dd34` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.620010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b988cd9c3940bc91b784d14d45dd34)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.620226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.642404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 841/1703] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.647318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.650872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.685427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aca57-59c4-42a5-a8c5-b6514591751c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.703222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b937888-d176-4b62-abae-84b77ee9caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.704122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b937888-d176-4b62-abae-84b77ee9caea admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.704498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b937888-d176-4b62-abae-84b77ee9caea admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.704866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b937888-d176-4b62-abae-84b77ee9caea admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.710160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b937888-d176-4b62-abae-84b77ee9caea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.712057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b937888-d176-4b62-abae-84b77ee9caea admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.712652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b988cd9c3940bc91b784d14d45dd34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.715670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b988cd9c3940bc91b784d14d45dd34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.729327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b988cd9c3940bc91b784d14d45dd34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.729975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b988cd9c3940bc91b784d14d45dd34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.739944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 842/1704] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:28.741566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338d196-c2e3-4baf-ade4-a990500527ff None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.742419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338d196-c2e3-4baf-ade4-a990500527ff None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.743981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338d196-c2e3-4baf-ade4-a990500527ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.775326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b988cd9c3940bc91b784d14d45dd34'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.789086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7338d196-c2e3-4baf-ade4-a990500527ff None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.792368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7338d196-c2e3-4baf-ade4-a990500527ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.794728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 863/1705] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:28 2022] DELETE /identity/v3/users/66b988cd9c3940bc91b784d14d45dd34 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:28.799257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.806431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.908445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:28.955663 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d05e-4957-46f3-9d4c-eb58a023e0ce admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.975544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 843/1706] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.975885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25450907-c9b2-4e41-a6f3-1ec686759cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.976836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450907-c9b2-4e41-a6f3-1ec686759cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.977141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.977500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.977916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.996307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450907-c9b2-4e41-a6f3-1ec686759cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.996808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25450907-c9b2-4e41-a6f3-1ec686759cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.997696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25450907-c9b2-4e41-a6f3-1ec686759cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.001436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25450907-c9b2-4e41-a6f3-1ec686759cfb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.026650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:29.028017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.030206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 864/1707] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:29.031789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.032283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.033664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.041033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 844/1708] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:29.042708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.082773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] MFA Rules not processed for user `73f1b9e32ad3493284c5df45afd042fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:29.084293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.130176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9ec4-9263-46de-9e39-ae86519f6479 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.149255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.155138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.155658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.161620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 865/1709] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:29.161620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.167949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.172401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd548-3102-4475-a21f-55c6338e6801 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.173572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:29.173927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.177331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.178268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.178395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.178717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.179080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] PATH_INFO: `/v3/projects/7efab1e2a0a546ca8b59c82fdf17cad1/users/857fac97fdf441b083e504d3e1cc88c6/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.196186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efab1e2a0a546ca8b59c82fdf17cad1, user_id=857fac97fdf441b083e504d3e1cc88c6, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.199066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.225340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 866/1710] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:29 2022] PUT /identity/v3/projects/7efab1e2a0a546ca8b59c82fdf17cad1/users/857fac97fdf441b083e504d3e1cc88c6/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:29.225579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 845/1711] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:29.227238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.229820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.231575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.294491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9563-7735-45c3-abee-60129dd6267f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.389987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2878-5629-4480-ab47-68d38fc7d76a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.402466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630303f9-694d-4ba0-8052-63d359823e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.412473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630303f9-694d-4ba0-8052-63d359823e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.416587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630303f9-694d-4ba0-8052-63d359823e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.416909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630303f9-694d-4ba0-8052-63d359823e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.544372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.548683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.548683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.552388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.553155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.555158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.601017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630303f9-694d-4ba0-8052-63d359823e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.605032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630303f9-694d-4ba0-8052-63d359823e95 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.628425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 867/1712] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:29.632342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.632755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.633207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.644406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 846/1713] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/projects => generated 403 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:29.645299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.737751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.750376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] MFA Rules not processed for user `857fac97fdf441b083e504d3e1cc88c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:29.751672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.859394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.876193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd371fa8-ed44-415b-ab34-91da9e401335 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.897127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.897949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.898323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.899464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.904619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.911911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.972639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 847/1714] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/users => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:29.973610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.989373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 868/1715] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:29.998408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.002628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650c164-7ceb-4f44-a13e-22fbd29007ae admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.012431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.013150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.013323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.013600 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.014302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.015917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.022376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a2fb7-4979-42ae-9bf3-982858fc5e84 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.050339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.051091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.051529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.051854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.054354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.056432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.081721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 848/1716] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.082831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.125252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6981f7a-6220-4714-b2db-a9ebd43a98c2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.147609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.148546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.148682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.148910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.149587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.162308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 869/1717] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:30.162764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.163707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.236576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 849/1718] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.237579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.282335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27664b8b-dbf1-4bd8-a7e4-df37dee6bc03 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.392232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09135a8f-f909-4292-b5b0-f070a26524c9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.405904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.406693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.407097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.407483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.408225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.410336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.453531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a24fd-cd32-4fab-ba19-e2586689f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.455846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 870/1719] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:30.457527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a24fd-cd32-4fab-ba19-e2586689f49d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.458028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a24fd-cd32-4fab-ba19-e2586689f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.458813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a24fd-cd32-4fab-ba19-e2586689f49d admin admin] PATH_INFO: `/v3/projects/a00981f8684e43d6afb12d6c22178b53/users/dca194e264224063aee9de46888da034/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.459820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.488211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776874-fbe8-424e-bde5-d0129f9bd3fe admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.498409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.498409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.498624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.498979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.499701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.499816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a24fd-cd32-4fab-ba19-e2586689f49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00981f8684e43d6afb12d6c22178b53, user_id=dca194e264224063aee9de46888da034, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.501463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.503655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a24fd-cd32-4fab-ba19-e2586689f49d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.528491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 850/1720] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:30 2022] PUT /identity/v3/projects/a00981f8684e43d6afb12d6c22178b53/users/dca194e264224063aee9de46888da034/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:30.530478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.530832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.531172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.536096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 871/1721] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.537570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.567902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f22824-88f2-4d34-b835-edc65d0c5e74 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.582916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:30.591159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.726558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a07fb6-ba58-453c-b5a9-fd5c79c61250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.727829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07fb6-ba58-453c-b5a9-fd5c79c61250 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.728364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07fb6-ba58-453c-b5a9-fd5c79c61250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.728822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07fb6-ba58-453c-b5a9-fd5c79c61250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.735995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a07fb6-ba58-453c-b5a9-fd5c79c61250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.738317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a07fb6-ba58-453c-b5a9-fd5c79c61250 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.750724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:30.782018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 872/1722] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.782018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d77b1-8d54-43b0-afc5-afc25b9cfaf8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.782018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d77b1-8d54-43b0-afc5-afc25b9cfaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.782018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d77b1-8d54-43b0-afc5-afc25b9cfaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.872542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 851/1723] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:30.873905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.894104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c86d77b1-8d54-43b0-afc5-afc25b9cfaf8 None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:30.903476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c86d77b1-8d54-43b0-afc5-afc25b9cfaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.911981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb3c03-fcc9-4ace-b8f0-fe0475167252 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.932483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.966100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.966506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.968283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] PATH_INFO: `/v3/projects/ffa8b87e906c4eb6a45547307128ec85/users/c898ce66620c4c7082778a16ed3dcede/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.023447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa8b87e906c4eb6a45547307128ec85, user_id=c898ce66620c4c7082778a16ed3dcede, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.032266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.086229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 852/1724] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:30 2022] PUT /identity/v3/projects/ffa8b87e906c4eb6a45547307128ec85/users/c898ce66620c4c7082778a16ed3dcede/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:31.086229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.139295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 873/1725] 10.222.0.71 () {58 vars in 1015 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:31.140884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:31.141174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:31.141447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.180971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:31.211543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] MFA Rules not processed for user `c898ce66620c4c7082778a16ed3dcede`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:31.214348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:31.241644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c418e-0a64-4535-8143-da8dd992f4f6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:31.247446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:31.248580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:31.249138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:31.249697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.448926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 874/1726] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:31.450039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.474393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b6f8b-94d4-4626-9364-18cd85708904 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:31.493265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:31.496940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:31.497367 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:31.497652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.504735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.506306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.521936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.531071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 853/1727] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:31.532056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.533761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.534308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:31.558023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 875/1728] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:31.561482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.590092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a8ae-2b02-468a-8023-67bf5ca16819 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:31.596445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:31.597240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:31.597346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:31.597616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] PATH_INFO: `/v3/projects/f2f2666fd0aa47c4b84a20fcb6c6da25` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.600903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f2666fd0aa47c4b84a20fcb6c6da25)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.602979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.607221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f4ff-8e3b-41d6-a796-385bcf4bf012 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:31.627202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:31.628882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:31.629324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:31.629666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.630543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.650755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.759446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f2666fd0aa47c4b84a20fcb6c6da25', 'request_id': 'req-f3b0a52e-73e7-4e00-807e-6cfb882463ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:31.773034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f2666fd0aa47c4b84a20fcb6c6da25', 'request_id': 'req-f3b0a52e-73e7-4e00-807e-6cfb882463ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:31.789701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f2666fd0aa47c4b84a20fcb6c6da25', 'request_id': 'req-f3b0a52e-73e7-4e00-807e-6cfb882463ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:31.796103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 876/1729] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:31 2022] POST /identity/v3/projects => generated 377 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:31.798114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.801810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:31.823412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] The token cache is being invalidate because project f2f2666fd0aa47c4b84a20fcb6c6da25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:31.824191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:31.835409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:31.839771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 854/1730] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:31 2022] DELETE /identity/v3/projects/f2f2666fd0aa47c4b84a20fcb6c6da25 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:31.861791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.868857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.000507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b63e-4d9c-4ba7-a9e6-37a2ce14285f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.032655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.033315 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.033593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.038430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.048793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.077053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.082546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.083799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:32.102183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 877/1731] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:32.103645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:32.105148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.106942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0a52e-73e7-4e00-807e-6cfb882463ed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.113986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:32.241313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.242302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.243423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.243820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.245328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.250797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.274071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9db56-797a-4138-933d-527f9a067e3c service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.289884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.291593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.292105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.294165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] PATH_INFO: `/v3/users/e7aafb2e8e504cb8bd89cec6aa3bf968` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.303112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7aafb2e8e504cb8bd89cec6aa3bf968)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.310041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.342872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 855/1732] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:31 2022] POST /identity/v3/users => generated 295 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:32.344901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:32.398933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed44d0-ab10-484d-bfed-40b9606698a7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.416205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.417340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.417627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.417912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.421807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.423617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.452570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7aafb2e8e504cb8bd89cec6aa3bf968'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:32.455952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7aafb2e8e504cb8bd89cec6aa3bf968'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:32.460509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 856/1733] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:32.466691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:32.477344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7aafb2e8e504cb8bd89cec6aa3bf968'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:32.478332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.478885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7aafb2e8e504cb8bd89cec6aa3bf968'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:32.518343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0fd99-f6e7-4c08-a59b-e799b33267e1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.522981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7aafb2e8e504cb8bd89cec6aa3bf968'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:32.545876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.546728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.547119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.547477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] PATH_INFO: `/v3/projects/50bf637bcd0a40dbbcb4d486b1f45230/users/33e0ba90ce324ebcb346e2d5e8396c8f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.559468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 878/1734] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:32 2022] DELETE /identity/v3/users/e7aafb2e8e504cb8bd89cec6aa3bf968 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:32.608323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bf637bcd0a40dbbcb4d486b1f45230, user_id=33e0ba90ce324ebcb346e2d5e8396c8f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.611648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.656369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 857/1735] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:32 2022] PUT /identity/v3/projects/50bf637bcd0a40dbbcb4d486b1f45230/users/33e0ba90ce324ebcb346e2d5e8396c8f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:32.661138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:32.890980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b30b-2011-467a-a02a-08af01f35d01 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.959292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:33.034644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660531da-4dde-4904-a953-0bf402acf74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:33.036010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660531da-4dde-4904-a953-0bf402acf74f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.036631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660531da-4dde-4904-a953-0bf402acf74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.038806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660531da-4dde-4904-a953-0bf402acf74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:33.039731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660531da-4dde-4904-a953-0bf402acf74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:33.045426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660531da-4dde-4904-a953-0bf402acf74f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:33.068277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 879/1736] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:33.073507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:33.093850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d66bb-29bf-4176-90ee-b9e39103295c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:33.122117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:33.126069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.126372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.126667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] PATH_INFO: `/v3/projects/50bf637bcd0a40dbbcb4d486b1f45230/users/33e0ba90ce324ebcb346e2d5e8396c8f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:33.132830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bf637bcd0a40dbbcb4d486b1f45230, user_id=33e0ba90ce324ebcb346e2d5e8396c8f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:33.135060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:33.177859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 858/1737] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:33 2022] PUT /identity/v3/projects/50bf637bcd0a40dbbcb4d486b1f45230/users/33e0ba90ce324ebcb346e2d5e8396c8f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:33.187569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.187849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.188119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:33.278167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] MFA Rules not processed for user `33e0ba90ce324ebcb346e2d5e8396c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:33.279153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:33.477866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 880/1738] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:33.491004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:33.493546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:33.676445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d368-97a1-4bc1-b838-13f3a40e1ffe admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:33.687028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b11a4-4946-4fd1-b0cf-dee85ec9209c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:33.693494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b11a4-4946-4fd1-b0cf-dee85ec9209c service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.693996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b11a4-4946-4fd1-b0cf-dee85ec9209c service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.694277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b11a4-4946-4fd1-b0cf-dee85ec9209c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:33.717989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b11a4-4946-4fd1-b0cf-dee85ec9209c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:33.719508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b11a4-4946-4fd1-b0cf-dee85ec9209c service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:33.756005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 859/1739] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:33.824545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:33.826287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:33.864626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc9abd-f293-41d8-9e21-5fd4d0ecd45f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:33.875895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:33.876575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.876852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.877122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:33.883486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:34.035293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:34.036544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:34.050022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 881/1740] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:35.255855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e61c35-2d11-4905-8bfd-9a26a0c83824 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:35.256988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e61c35-2d11-4905-8bfd-9a26a0c83824 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:35.257468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e61c35-2d11-4905-8bfd-9a26a0c83824 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:35.259506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 860/1741] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:54:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:35.376758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:35.380675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:35.400153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ecf01-7926-4cee-bb58-876e9e26d47b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:35.400432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ecf01-7926-4cee-bb58-876e9e26d47b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:35.400862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ecf01-7926-4cee-bb58-876e9e26d47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:35.498910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-832ecf01-7926-4cee-bb58-876e9e26d47b None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:35.500171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-832ecf01-7926-4cee-bb58-876e9e26d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:35.662743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:35.722591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:35.730130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed5cf-8d0d-48df-a301-4c9853c7862e service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:35.750371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:35.750543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:35.754190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:35.754867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] PATH_INFO: `/v3/projects/6852a524465c426098a4b931baf50605` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:35.764987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6852a524465c426098a4b931baf50605)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:35.767317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: WARNING py.warnings [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:54:35.767317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: warnings.warn(msg) Aug 31 10:54:35.767317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: Aug 31 10:54:35.778934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:35.868059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 861/1742] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:36.003648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6852a524465c426098a4b931baf50605', 'request_id': 'req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.058734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6852a524465c426098a4b931baf50605', 'request_id': 'req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.083345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6852a524465c426098a4b931baf50605', 'request_id': 'req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.114616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] The token cache is being invalidate because project 6852a524465c426098a4b931baf50605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:36.115010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.119394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.121479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 882/1743] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:35 2022] DELETE /identity/v3/projects/6852a524465c426098a4b931baf50605 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:36.128226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7d55-fdcb-44cf-9f95-32e9d4f77501 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.128919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7d55-fdcb-44cf-9f95-32e9d4f77501 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.129646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7d55-fdcb-44cf-9f95-32e9d4f77501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.217956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.218260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bead7d55-fdcb-44cf-9f95-32e9d4f77501 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:36.219749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.222386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bead7d55-fdcb-44cf-9f95-32e9d4f77501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.379807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf092d42-fe53-4cfb-9924-c09e4a8d0aea admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:36.417065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 862/1744] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:36.418467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.418755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.419021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.419781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:36.420676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.421133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.421588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.425041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.445931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:36.447875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.454729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:36.458109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.470722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 883/1745] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:36.477734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 863/1746] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:36.478809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.496082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b597f0-e00e-4b98-8e79-4bf0f96ecd4d service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:36.514470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:36.515118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.515393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.515843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.516672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:36.517143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:36.519002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.554981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.562729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 884/1747] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:54:36.571257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6183-2771-4083-bd58-5c90b7013ea8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:36.577186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3153a-73e8-40a6-b89c-55f50f2f0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:36.578097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3153a-73e8-40a6-b89c-55f50f2f0eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.578657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3153a-73e8-40a6-b89c-55f50f2f0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.578925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3153a-73e8-40a6-b89c-55f50f2f0eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.579815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3153a-73e8-40a6-b89c-55f50f2f0eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:36.586920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3153a-73e8-40a6-b89c-55f50f2f0eaf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.654742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.665648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 864/1748] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:36.666982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733fa4f-f138-4366-93d3-3b0dc5642095 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:36.744547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:36.751384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2de6f9-b699-4321-bf89-dabb2e312647 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.751849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2de6f9-b699-4321-bf89-dabb2e312647 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.752252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2de6f9-b699-4321-bf89-dabb2e312647 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.753970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 865/1749] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:54:36.765610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:36.767938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.768382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.771251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.772568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:36.778034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.781515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.782045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.782424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.831490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 885/1750] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:36.833755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.849355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:36.852161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.866937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90bc9-87c0-4e18-aa5e-e33438226ed0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:36.881037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa813ceb-8aa4-45a5-a86c-7ebe763552bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:36.882120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa813ceb-8aa4-45a5-a86c-7ebe763552bf admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.885981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa813ceb-8aa4-45a5-a86c-7ebe763552bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.888109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa813ceb-8aa4-45a5-a86c-7ebe763552bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.889865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa813ceb-8aa4-45a5-a86c-7ebe763552bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:36.895165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa813ceb-8aa4-45a5-a86c-7ebe763552bf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.935035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 886/1751] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:36.936900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.937370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.937898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.974059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] MFA Rules not processed for user `dca194e264224063aee9de46888da034`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:36.975749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:37.100840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 866/1752] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:37.100840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:37.116892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 887/1753] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:37.118099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:37.121651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:37.129752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c83b4-3ac9-42fd-a4d7-a5a011ceace1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:37.142809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:37.143509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:37.143801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:37.144158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:37.144690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:37.146359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:37.152206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e51f3-ee57-401f-a67d-c8d730ae791e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:37.192206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:37.196063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:37.196421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:37.196712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:37.200599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 867/1754] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:37.207851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:37.210079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:37.211992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:37.259050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0b904-54d6-40d5-a729-147dcaad1dca admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:37.274873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37da0-7a19-4e3b-b115-02d8a8d3cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:37.275395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37da0-7a19-4e3b-b115-02d8a8d3cd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:37.275760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37da0-7a19-4e3b-b115-02d8a8d3cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:37.276029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37da0-7a19-4e3b-b115-02d8a8d3cd02 admin admin] PATH_INFO: `/v3/projects/77108c6296184ccd90ef88ece8868e9b/users/56e73ad301f34d898b8fe25165e227c8/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:37.296561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a37da0-7a19-4e3b-b115-02d8a8d3cd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77108c6296184ccd90ef88ece8868e9b, user_id=56e73ad301f34d898b8fe25165e227c8, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:37.299536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a37da0-7a19-4e3b-b115-02d8a8d3cd02 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:37.335435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 888/1755] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:37 2022] POST /identity/v3/projects => generated 403 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:37.353640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:37.375134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 868/1756] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:37 2022] PUT /identity/v3/projects/77108c6296184ccd90ef88ece8868e9b/users/56e73ad301f34d898b8fe25165e227c8/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:37.377098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:37.380827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:37.381803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:37.439674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:37.524780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] MFA Rules not processed for user `56e73ad301f34d898b8fe25165e227c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:37.528031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:37.782649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 869/1757] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:37.791945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:37.796093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b20a5-5192-4cd7-b922-2f6683b73419 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:37.998671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:38.024575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b02514-70a2-4c58-940e-d412c4103fc3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.034473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.035628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.036016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.036353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.040109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.043831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.059356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.061405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.061787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.063409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.064072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.067237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.112472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 870/1758] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:37 2022] POST /identity/v3/projects => generated 391 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:38.114361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.190371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 889/1759] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:37 2022] POST /identity/v3/users => generated 308 bytes in 852 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:38.190371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.194434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:38.294566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b683ee-eae0-484e-a70c-1016a3e897d5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.304455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.309316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.309885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.310346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.311196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.313441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.361723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 871/1760] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:38 2022] POST /identity/v3/users => generated 302 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:38.366018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.391626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ea05-e42b-4b26-8aa2-5fa3f0a900a4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.398166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6cc56-983b-4538-bad3-8d6afd7c78fd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.409925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.410580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.410847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.411108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.411944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.416019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.427519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:38.469578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 872/1761] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:38.478334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.516614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dea00-5dac-4a5b-9ef3-41a7ed59b7ec admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.523778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.524585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.524982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.525562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.532399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.533689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.533994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.534265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.536833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.537669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.538801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.544121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.575833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 890/1762] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:38.578090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.580655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 873/1763] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:38.588305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.608330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586cb7-54d2-4076-a9fb-8c1765f7ac76 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.613808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ef03-21ac-455d-921a-dfdec3096bf6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.626757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.627634 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.628011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.628381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] PATH_INFO: `/v3/projects/0850929678f94cab841f5114a0618369/users/32d94252bb8e4de6b79058534afe963c/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.639260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.639957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.640231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.640501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] PATH_INFO: `/v3/projects/685857ec77db4bc084c7f27059bcbffd/users/068ce1766a60485492c56728b764a216/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.678066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0850929678f94cab841f5114a0618369, user_id=32d94252bb8e4de6b79058534afe963c, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.681574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.689306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=685857ec77db4bc084c7f27059bcbffd, user_id=068ce1766a60485492c56728b764a216, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.702622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.726848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 891/1764] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:38 2022] PUT /identity/v3/projects/0850929678f94cab841f5114a0618369/users/32d94252bb8e4de6b79058534afe963c/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:38.731980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.740897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 874/1765] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:38 2022] PUT /identity/v3/projects/685857ec77db4bc084c7f27059bcbffd/users/068ce1766a60485492c56728b764a216/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:38.744646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.870088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c45b-d42f-4491-b28c-0787970e23ef admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.875457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.876660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.877082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.877484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.878875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.881424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.882012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:38.939333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 875/1766] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:38.941224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.963254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99bd73-9779-49b5-a95b-71c06d430810 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.979278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43668037-8b45-486d-a09d-fd6268cf9690 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.989899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.989899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.989899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.989899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] PATH_INFO: `/v3/projects/685857ec77db4bc084c7f27059bcbffd/users/068ce1766a60485492c56728b764a216/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.995944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=685857ec77db4bc084c7f27059bcbffd, user_id=068ce1766a60485492c56728b764a216, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.995944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.999427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac730c29-7103-4efc-a73a-2a1bc8fced1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.000341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac730c29-7103-4efc-a73a-2a1bc8fced1d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.000797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac730c29-7103-4efc-a73a-2a1bc8fced1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.001128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac730c29-7103-4efc-a73a-2a1bc8fced1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.002093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac730c29-7103-4efc-a73a-2a1bc8fced1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.004793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac730c29-7103-4efc-a73a-2a1bc8fced1d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.046360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 876/1767] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:38 2022] PUT /identity/v3/projects/685857ec77db4bc084c7f27059bcbffd/users/068ce1766a60485492c56728b764a216/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:39.047450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.048122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 892/1768] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:39.059887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.060491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.063924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.170566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] MFA Rules not processed for user `068ce1766a60485492c56728b764a216`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:39.176236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:39.329936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b2bc-de10-4f63-a120-0ecd9a9a0981 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.346888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.351974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.351974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.351974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] PATH_INFO: `/v3/projects/0850929678f94cab841f5114a0618369/users/32d94252bb8e4de6b79058534afe963c/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.357157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0850929678f94cab841f5114a0618369, user_id=32d94252bb8e4de6b79058534afe963c, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.368494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.409499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 877/1769] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:39 2022] PUT /identity/v3/projects/0850929678f94cab841f5114a0618369/users/32d94252bb8e4de6b79058534afe963c/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:39.500228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 893/1770] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:39.581651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.585463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:39.699133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.700783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:39.742974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9321-6a71-4dc1-8beb-c82ede2d8e13 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.790201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:39.852073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cfd7-d02f-4d33-afa2-af386e155158 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.867711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96b8e-6130-48c2-b059-87ca53855a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.867711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96b8e-6130-48c2-b059-87ca53855a6c service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.867711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96b8e-6130-48c2-b059-87ca53855a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.867711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96b8e-6130-48c2-b059-87ca53855a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.901197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.903839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.904223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.904575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] PATH_INFO: `/v3/users/857fac97fdf441b083e504d3e1cc88c6` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.914045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857fac97fdf441b083e504d3e1cc88c6)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.915196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.034439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857fac97fdf441b083e504d3e1cc88c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:40.035414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857fac97fdf441b083e504d3e1cc88c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:40.056271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857fac97fdf441b083e504d3e1cc88c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:40.057300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857fac97fdf441b083e504d3e1cc88c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:40.062201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:40.063688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96b8e-6130-48c2-b059-87ca53855a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.065467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96b8e-6130-48c2-b059-87ca53855a6c service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.091035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 878/1771] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:40.091942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857fac97fdf441b083e504d3e1cc88c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:40.133424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 894/1772] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:39 2022] DELETE /identity/v3/users/857fac97fdf441b083e504d3e1cc88c6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:40.137705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.138288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.138773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.170721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.173719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:40.177026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:40.198948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:40.330242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27616abc-a769-400e-805f-c576323e4209 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.332303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 879/1773] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:40.341622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.342350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.342619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.342892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.345262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:40.347433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.351489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:40.416740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.418442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.432778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 895/1774] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:40.468484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5eec-714f-4981-bc90-b0dd57c8c41e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.504153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.504998 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.505341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.505683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.519717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.521233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.542119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 880/1775] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:41.575376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:41.577654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:41.606694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f8151-4bd8-442c-9c2d-a1ba9c1819be service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:41.611781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:41.612752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:41.613259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:41.614426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] PATH_INFO: `/v3/projects/7efab1e2a0a546ca8b59c82fdf17cad1` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.615892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efab1e2a0a546ca8b59c82fdf17cad1)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:41.618158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:41.693074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efab1e2a0a546ca8b59c82fdf17cad1', 'request_id': 'req-65f254b9-4f2f-4473-a43c-109ba080e227'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.707750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efab1e2a0a546ca8b59c82fdf17cad1', 'request_id': 'req-65f254b9-4f2f-4473-a43c-109ba080e227'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.730093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efab1e2a0a546ca8b59c82fdf17cad1', 'request_id': 'req-65f254b9-4f2f-4473-a43c-109ba080e227'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.744238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] The token cache is being invalidate because project 7efab1e2a0a546ca8b59c82fdf17cad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:41.744755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.745738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-65f254b9-4f2f-4473-a43c-109ba080e227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.748047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 896/1776] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:41 2022] DELETE /identity/v3/projects/7efab1e2a0a546ca8b59c82fdf17cad1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:41.752258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:41.766974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c80c-9630-45aa-832d-eb76cf2b9ee3 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:41.810115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:41.858247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:41.859297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:41.859510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:41.859992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] PATH_INFO: `/v3/users/c898ce66620c4c7082778a16ed3dcede` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.861545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c898ce66620c4c7082778a16ed3dcede)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:41.864166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:41.937635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c898ce66620c4c7082778a16ed3dcede'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.949174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c898ce66620c4c7082778a16ed3dcede'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.950086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c898ce66620c4c7082778a16ed3dcede'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.973351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c898ce66620c4c7082778a16ed3dcede'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.974392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c898ce66620c4c7082778a16ed3dcede'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:41.997022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 881/1777] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:41 2022] DELETE /identity/v3/users/c898ce66620c4c7082778a16ed3dcede => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:42.239373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:42.239373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:42.239373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:42.268476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:42.278345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:42.279853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:42.283070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] MFA Rules not processed for user `32d94252bb8e4de6b79058534afe963c`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:42.285410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:42.400597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07dc2-738d-49bf-92fe-3c9eb818da2c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:42.409115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:42.410044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:42.410406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:42.410626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] PATH_INFO: `/v3/users/3a08cba5a7d24945ada0a2ce56d70805` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:42.412088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a08cba5a7d24945ada0a2ce56d70805)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:42.415447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:42.446440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 897/1778] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:42.446440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:42.448181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:42.475437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8da1f-3e37-4235-9027-a219f66238f4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:42.486905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:42.488789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:42.489080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:42.489366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] PATH_INFO: `/v3/projects/ffa8b87e906c4eb6a45547307128ec85` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:42.492179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa8b87e906c4eb6a45547307128ec85)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:42.499058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:42.533704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a08cba5a7d24945ada0a2ce56d70805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.549358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a08cba5a7d24945ada0a2ce56d70805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.550251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a08cba5a7d24945ada0a2ce56d70805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.553131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:42.576933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a08cba5a7d24945ada0a2ce56d70805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.577688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8aa94641-5ad4-41ed-8028-fb0cf47beb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a08cba5a7d24945ada0a2ce56d70805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.591491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa8b87e906c4eb6a45547307128ec85', 'request_id': 'req-5b4d468c-c04b-4d79-a254-b2f510c06e18'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.596547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 882/1779] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:42 2022] DELETE /identity/v3/users/3a08cba5a7d24945ada0a2ce56d70805 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:42.601207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:42.602098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:42.605247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:42.605377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa8b87e906c4eb6a45547307128ec85', 'request_id': 'req-5b4d468c-c04b-4d79-a254-b2f510c06e18'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.623400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa8b87e906c4eb6a45547307128ec85', 'request_id': 'req-5b4d468c-c04b-4d79-a254-b2f510c06e18'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.632776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:42.634914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:42.643995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] The token cache is being invalidate because project ffa8b87e906c4eb6a45547307128ec85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:42.644365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.645294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.651323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 898/1780] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:42 2022] DELETE /identity/v3/projects/ffa8b87e906c4eb6a45547307128ec85 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:42.654216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:42.658979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:42.730977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 883/1781] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:42.744083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:42.745622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:42.803603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d468c-c04b-4d79-a254-b2f510c06e18 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:42.815662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:42.818264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:42.821081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:42.821893 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] PATH_INFO: `/v3/users/33e0ba90ce324ebcb346e2d5e8396c8f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:42.824361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e0ba90ce324ebcb346e2d5e8396c8f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:42.831220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:42.841599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114c8ad-bbcc-4366-aab7-1655350476ed None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:42.853876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9b7bc-5930-457d-b8b7-d8d48210e97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:42.854782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9b7bc-5930-457d-b8b7-d8d48210e97f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:42.855163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9b7bc-5930-457d-b8b7-d8d48210e97f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:42.855662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9b7bc-5930-457d-b8b7-d8d48210e97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:42.869743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9b7bc-5930-457d-b8b7-d8d48210e97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:42.871765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9b7bc-5930-457d-b8b7-d8d48210e97f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:42.888060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 884/1782] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:42.901674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:42.946233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e0ba90ce324ebcb346e2d5e8396c8f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.947895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e0ba90ce324ebcb346e2d5e8396c8f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.960298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e0ba90ce324ebcb346e2d5e8396c8f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.960866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e0ba90ce324ebcb346e2d5e8396c8f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:42.986609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-28bc05b7-fc36-4bca-b427-4d571b006495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e0ba90ce324ebcb346e2d5e8396c8f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:43.001434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 899/1783] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:42 2022] DELETE /identity/v3/users/33e0ba90ce324ebcb346e2d5e8396c8f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:43.584594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdb150-2f15-4fb6-bc2d-a598fdf1831a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:43.584879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdb150-2f15-4fb6-bc2d-a598fdf1831a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:43.585156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdb150-2f15-4fb6-bc2d-a598fdf1831a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:43.586810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 885/1784] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:43.625575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:43.626172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:43.626172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:43.662221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:43.663872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:43.767950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 900/1785] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:43.773440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdb150-2f15-4fb6-bc2d-a598fdf1831a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:43.776757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-02bdb150-2f15-4fb6-bc2d-a598fdf1831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:43.783823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:43.786516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:43.800246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefdd42-c581-4cef-b6c7-0d5ccdd1e5b0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:43.806157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:43.807115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:43.807616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:43.807888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:43.817997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:43.819658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:43.836579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 901/1786] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:43.871027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdb150-2f15-4fb6-bc2d-a598fdf1831a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:43.876610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:43.877443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:43.877714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:43.878407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] PATH_INFO: `/v3/projects/28d43c7790a9441c9cca6cb9127d5f51` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:43.881618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d43c7790a9441c9cca6cb9127d5f51)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:43.883981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:43.905088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:43.936974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d43c7790a9441c9cca6cb9127d5f51', 'request_id': 'req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:43.943775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d43c7790a9441c9cca6cb9127d5f51', 'request_id': 'req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:43.954085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d43c7790a9441c9cca6cb9127d5f51', 'request_id': 'req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:43.965669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] The token cache is being invalidate because project 28d43c7790a9441c9cca6cb9127d5f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:43.965987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:43.966638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:43.968371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 886/1787] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:43 2022] DELETE /identity/v3/projects/28d43c7790a9441c9cca6cb9127d5f51 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:43.973623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:43.984944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776902fc-8c63-4686-8f4e-3749a3dd6d3c service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.021094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.022590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:44.067709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.068715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.068715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.068971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] PATH_INFO: `/v3/users/4613cfb8e7bd4feba0311f6001149ac5` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.070203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4613cfb8e7bd4feba0311f6001149ac5)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.072185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.109223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6a9c-7aef-4861-ab86-c02916eae7b7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.114522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:44.115281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.116168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.116610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.116831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] PATH_INFO: `/v3/projects/50bf637bcd0a40dbbcb4d486b1f45230` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.118539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bf637bcd0a40dbbcb4d486b1f45230)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.120790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.154323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4613cfb8e7bd4feba0311f6001149ac5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.155066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4613cfb8e7bd4feba0311f6001149ac5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.167086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4613cfb8e7bd4feba0311f6001149ac5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.169840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4613cfb8e7bd4feba0311f6001149ac5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.190830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5e54afc1-8147-4cca-8826-e075e9a885f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4613cfb8e7bd4feba0311f6001149ac5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.212287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bf637bcd0a40dbbcb4d486b1f45230', 'request_id': 'req-d6d78806-dcc6-4736-bebf-355125f7fd38'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.213838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 902/1788] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:43 2022] DELETE /identity/v3/users/4613cfb8e7bd4feba0311f6001149ac5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:44.219806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bf637bcd0a40dbbcb4d486b1f45230', 'request_id': 'req-d6d78806-dcc6-4736-bebf-355125f7fd38'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.234052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bf637bcd0a40dbbcb4d486b1f45230', 'request_id': 'req-d6d78806-dcc6-4736-bebf-355125f7fd38'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.245995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] The token cache is being invalidate because project 50bf637bcd0a40dbbcb4d486b1f45230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:44.246475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.248127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d6d78806-dcc6-4736-bebf-355125f7fd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.254141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 887/1789] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:44 2022] DELETE /identity/v3/projects/50bf637bcd0a40dbbcb4d486b1f45230 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:44.255893 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.256217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.256495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.282506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:44.283984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:44.369655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 903/1790] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:44.378200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.379130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.379959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.433857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:44.434569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:44.458858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 888/1791] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:44.466242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.480479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ac6f-36d9-478a-956c-2ec0157f2c33 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.488939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.490679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.491269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.491839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.492775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:44.493351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.495476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.513319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 904/1792] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:44.514219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.525505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82a4d-5295-4d5d-81e9-c057a1e6094d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.530896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.531678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.532897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.533215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.534858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.536914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.583768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 889/1793] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:44 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:44.585023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.592330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.598855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:44.601223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55140d94-eded-4bfd-a4c9-87c1aa21475d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.630282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:44.723856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.724507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.724812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.725088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.725748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.727394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3884c4-4af1-4e92-bbbe-5dd61621f6b3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.727785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.732337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.733078 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.733420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.733759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] PATH_INFO: `/v3/users/dca194e264224063aee9de46888da034` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.735050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca194e264224063aee9de46888da034)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.737112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.761547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 905/1794] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:44 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:44.765501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.767695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:44.781520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346a27-e5ae-4526-b7dc-c060a90418e5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:44.787045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:44.787756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.788035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.788305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] PATH_INFO: `/v3/users/56e73ad301f34d898b8fe25165e227c8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.789480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e73ad301f34d898b8fe25165e227c8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:44.791627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:44.808136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:44.809749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca194e264224063aee9de46888da034'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.824515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca194e264224063aee9de46888da034'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.826922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca194e264224063aee9de46888da034'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.856831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca194e264224063aee9de46888da034'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.857506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca194e264224063aee9de46888da034'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.867940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e73ad301f34d898b8fe25165e227c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.868948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e73ad301f34d898b8fe25165e227c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.879841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 890/1795] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:44 2022] DELETE /identity/v3/users/dca194e264224063aee9de46888da034 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:44.880704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:44.883641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e73ad301f34d898b8fe25165e227c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.884658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e73ad301f34d898b8fe25165e227c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.884770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:44.924393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3da32426-f061-4a6f-a744-8d97b31fd3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e73ad301f34d898b8fe25165e227c8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:44.941072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 906/1796] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:44 2022] DELETE /identity/v3/users/56e73ad301f34d898b8fe25165e227c8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:44.947642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190bca-2147-4e33-b720-da80c82749de None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:44.948823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190bca-2147-4e33-b720-da80c82749de None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:44.948823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190bca-2147-4e33-b720-da80c82749de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:44.979910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-70190bca-2147-4e33-b720-da80c82749de None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:44.984331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-70190bca-2147-4e33-b720-da80c82749de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.019918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567d6d-7f66-481a-9247-64486ec29d13 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.104964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:45.126099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 907/1797] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:45.151584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.152870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.153146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.153417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.154096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.156094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.168358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190bca-2147-4e33-b720-da80c82749de None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.169879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-70190bca-2147-4e33-b720-da80c82749de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.177342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 891/1798] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:45.181726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.185084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.215217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859880dd-a97f-4eff-9150-f169758226e8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.228484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.229120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.229390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.229653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.230339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.233150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.264956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 892/1799] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:45.269335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.307143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dde2c-55ef-47ba-8748-952c2d559d6f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.316196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bfcd-e642-4e76-addc-98bd071707cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.317201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bfcd-e642-4e76-addc-98bd071707cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.317862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bfcd-e642-4e76-addc-98bd071707cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.318003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190bca-2147-4e33-b720-da80c82749de None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.326351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bfcd-e642-4e76-addc-98bd071707cf admin admin] PATH_INFO: `/v3/projects/10640e0c843c4ac2a5698f69fb29b510/users/9de17983ea46421599a8a41baf748786/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.334498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.335997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.336309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.336872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.354175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.356399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.365701 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bfcd-e642-4e76-addc-98bd071707cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=10640e0c843c4ac2a5698f69fb29b510, user_id=9de17983ea46421599a8a41baf748786, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.376110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bfcd-e642-4e76-addc-98bd071707cf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.378315 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 908/1800] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:45.379679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.383313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.402489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752de01-db31-4cf6-905c-213262443c19 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.409876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 893/1801] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:45 2022] PUT /identity/v3/projects/10640e0c843c4ac2a5698f69fb29b510/users/9de17983ea46421599a8a41baf748786/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:45.413064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.413316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.413586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.450479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] MFA Rules not processed for user `9de17983ea46421599a8a41baf748786`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:45.452025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.484461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:45.603257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 894/1802] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:45.606452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.614219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.619993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.620433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.621213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] PATH_INFO: `/v3/projects/a00981f8684e43d6afb12d6c22178b53` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.627146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00981f8684e43d6afb12d6c22178b53)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.637453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.656886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb004603-e92f-4c18-b17c-14a3b9cca82e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.671637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.672805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.673368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.673762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.674750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.690362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.762724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 895/1803] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:45 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:45.764010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.768245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.771516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00981f8684e43d6afb12d6c22178b53', 'request_id': 'req-507d862c-2d6c-466c-9b80-0560ebf95a3c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:45.786424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00981f8684e43d6afb12d6c22178b53', 'request_id': 'req-507d862c-2d6c-466c-9b80-0560ebf95a3c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:45.802765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00981f8684e43d6afb12d6c22178b53', 'request_id': 'req-507d862c-2d6c-466c-9b80-0560ebf95a3c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:45.822757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] The token cache is being invalidate because project a00981f8684e43d6afb12d6c22178b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:45.823052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:45.824195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:45.827176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 909/1804] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:45 2022] DELETE /identity/v3/projects/a00981f8684e43d6afb12d6c22178b53 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:45.827949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:45.829492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:45.930008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9d30b-03a4-4511-8986-cbcc3f25b769 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:45.945176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:45.945920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:45.946195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:45.946464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] PATH_INFO: `/v3/projects/4e59266b765f466b91edc2c04d1fb613` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:45.948975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e59266b765f466b91edc2c04d1fb613)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:45.951033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:45.958618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:46.000329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d862c-2d6c-466c-9b80-0560ebf95a3c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.010190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.010950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.011446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.012467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.015487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.019628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.036912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e59266b765f466b91edc2c04d1fb613', 'request_id': 'req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.045663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e59266b765f466b91edc2c04d1fb613', 'request_id': 'req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.056149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 910/1805] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:45 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:46.061287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.062318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e59266b765f466b91edc2c04d1fb613', 'request_id': 'req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.064130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.078986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2a8d-a5e4-4cdf-a7f8-ceb49817766c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.082996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] The token cache is being invalidate because project 4e59266b765f466b91edc2c04d1fb613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:46.083354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.084106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.089047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 896/1806] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:45 2022] DELETE /identity/v3/projects/4e59266b765f466b91edc2c04d1fb613 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:46.089047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.089047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.190171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:46.192563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed27a-fb14-44df-8543-19b9a6d8bed7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.205339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.206166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.206888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.207561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121e158-df19-4e22-a2e4-4d5797f30b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.208173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e158-df19-4e22-a2e4-4d5797f30b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.208440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e158-df19-4e22-a2e4-4d5797f30b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.208705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e158-df19-4e22-a2e4-4d5797f30b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.209559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121e158-df19-4e22-a2e4-4d5797f30b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.210183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] PATH_INFO: `/v3/users/32d94252bb8e4de6b79058534afe963c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.212338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121e158-df19-4e22-a2e4-4d5797f30b29 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.214477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d94252bb8e4de6b79058534afe963c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.216666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.242630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 897/1807] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:46.258097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.259759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.259759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.289979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:46.291212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.309542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 898/1808] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:46.311242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.318918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.331204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d94252bb8e4de6b79058534afe963c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.332573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d94252bb8e4de6b79058534afe963c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.351191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d94252bb8e4de6b79058534afe963c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.352017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d94252bb8e4de6b79058534afe963c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.358741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a584b00-b227-4c56-b8cc-1643ac8a972e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.371352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.372752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.372752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.386542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] PATH_INFO: `/v3/projects/77108c6296184ccd90ef88ece8868e9b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.390985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=77108c6296184ccd90ef88ece8868e9b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.398127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.409245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d94252bb8e4de6b79058534afe963c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.440887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 911/1809] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:46 2022] DELETE /identity/v3/users/32d94252bb8e4de6b79058534afe963c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:46.445980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.457608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.562095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77108c6296184ccd90ef88ece8868e9b', 'request_id': 'req-87e688fa-12bf-45ff-ab92-2e70466f85bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.577074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77108c6296184ccd90ef88ece8868e9b', 'request_id': 'req-87e688fa-12bf-45ff-ab92-2e70466f85bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.602388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77108c6296184ccd90ef88ece8868e9b', 'request_id': 'req-87e688fa-12bf-45ff-ab92-2e70466f85bf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.626049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] The token cache is being invalidate because project 77108c6296184ccd90ef88ece8868e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:46.627330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.629704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-87e688fa-12bf-45ff-ab92-2e70466f85bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:46.633678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 899/1810] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:46 2022] DELETE /identity/v3/projects/77108c6296184ccd90ef88ece8868e9b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:46.635061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.641915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.642305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.658554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc58749-6ff4-4f6e-8ab9-ba7b0e0043a1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.671928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:46.690747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:46.698872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.851820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.852623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.852902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.853172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] PATH_INFO: `/v3/projects/91e127c5e1bb44989a97de803c8d8ecb/users/7cb4961ba6794da28deedc8177e55c0a/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.886457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 900/1811] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:46.887490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.890177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:46.904276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e127c5e1bb44989a97de803c8d8ecb, user_id=7cb4961ba6794da28deedc8177e55c0a, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.907177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.921696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81700d-a6f6-4093-96a6-c732e9eb651d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.930693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.932592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.932910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.933194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] PATH_INFO: `/v3/users/068ce1766a60485492c56728b764a216` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.936518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=068ce1766a60485492c56728b764a216)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.940743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.941762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 912/1812] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:46 2022] PUT /identity/v3/projects/91e127c5e1bb44989a97de803c8d8ecb/users/7cb4961ba6794da28deedc8177e55c0a/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:46.942649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.951863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:47.060584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068ce1766a60485492c56728b764a216'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.075646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068ce1766a60485492c56728b764a216'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.076313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068ce1766a60485492c56728b764a216'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.103523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068ce1766a60485492c56728b764a216'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.104396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068ce1766a60485492c56728b764a216'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.112359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d00d6-12c2-414b-b23c-99ef009160db admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.129469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.130894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.131204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.131615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.132962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 901/1813] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:46 2022] DELETE /identity/v3/users/068ce1766a60485492c56728b764a216 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:47.133650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:47.133650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.135788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.137489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.138814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:47.153403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 913/1814] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:47.159043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.163124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:47.198064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d2e2-ef17-4bdf-8df8-40d8cc3f93a4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.312355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacb140-1801-42a9-b4c1-5a1e31de3f3a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.322050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.322734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.323017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.324535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.325274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.328916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.349366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 902/1815] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:47.353486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.371314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.371660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe72d10-b3f2-4942-a687-a63131c0c314 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.371960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.372236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.372618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.373947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.379239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed320fa-f0ed-4a07-b923-32b5cdd9850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.380047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed320fa-f0ed-4a07-b923-32b5cdd9850b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.380392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed320fa-f0ed-4a07-b923-32b5cdd9850b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.380557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.380801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed320fa-f0ed-4a07-b923-32b5cdd9850b admin admin] PATH_INFO: `/v3/projects/91e127c5e1bb44989a97de803c8d8ecb/users/7cb4961ba6794da28deedc8177e55c0a/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.383293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed320fa-f0ed-4a07-b923-32b5cdd9850b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e127c5e1bb44989a97de803c8d8ecb, user_id=7cb4961ba6794da28deedc8177e55c0a, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.387297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed320fa-f0ed-4a07-b923-32b5cdd9850b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.404900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 903/1816] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:47 2022] PUT /identity/v3/projects/91e127c5e1bb44989a97de803c8d8ecb/users/7cb4961ba6794da28deedc8177e55c0a/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:47.425521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.426006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.426660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.445816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 914/1817] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:47 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:47.446371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:47.452894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.508991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] MFA Rules not processed for user `7cb4961ba6794da28deedc8177e55c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:47.511441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:47.597095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eca5f2-8521-4ae1-8461-eac8e5a02f65 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.624492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.626892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.629565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.630097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.633501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.638344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.703043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 904/1818] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:47.704181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.705660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:47.719115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 915/1819] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:47 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:47.733505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.742986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:47.754948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31fd13-3009-4837-80c0-b3a57608b540 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.764635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.765296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.765569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.765913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] PATH_INFO: `/v3/projects/0850929678f94cab841f5114a0618369` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.769111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:47.770388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0850929678f94cab841f5114a0618369)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.772565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.855171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7a6b4-8dca-4486-8349-6106d9fcf93f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.859801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:47.860871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.861324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.861763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.872177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:47.873958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:47.876402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0850929678f94cab841f5114a0618369', 'request_id': 'req-d8103ac6-6c29-4d37-8c44-a025f4e99986'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.884069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0850929678f94cab841f5114a0618369', 'request_id': 'req-d8103ac6-6c29-4d37-8c44-a025f4e99986'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.890652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 916/1820] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:47.891973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:47.900220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0850929678f94cab841f5114a0618369', 'request_id': 'req-d8103ac6-6c29-4d37-8c44-a025f4e99986'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.916257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1bc4-114f-42de-91fd-7c00a0c72e7b service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:47.925220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] The token cache is being invalidate because project 0850929678f94cab841f5114a0618369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:47.926930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.928098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d8103ac6-6c29-4d37-8c44-a025f4e99986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:47.933369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 905/1821] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:47 2022] DELETE /identity/v3/projects/0850929678f94cab841f5114a0618369 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:47.941922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.942524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.942955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.990953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:47.994561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.003086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.004058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.004166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.004411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.005053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.007347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.023718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 917/1822] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:48.023718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.040276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.078859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1960f7-9d64-4e37-beb9-9e8727ef5628 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.084681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.089755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.089755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.089755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] PATH_INFO: `/v3/projects/685857ec77db4bc084c7f27059bcbffd` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.089755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] RBAC: Authorizing `identity:delete_project(project_id=685857ec77db4bc084c7f27059bcbffd)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.090720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.106778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 906/1823] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:48.107684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.109108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.123122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d8b2-ac6b-4d91-9a06-b9821337d1c5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.130456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfdb45-1eb0-4f09-b2b7-5b343e55c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.130456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfdb45-1eb0-4f09-b2b7-5b343e55c30e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.130456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfdb45-1eb0-4f09-b2b7-5b343e55c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.130456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfdb45-1eb0-4f09-b2b7-5b343e55c30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.130767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfdb45-1eb0-4f09-b2b7-5b343e55c30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.132313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfdb45-1eb0-4f09-b2b7-5b343e55c30e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.138282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:48.144215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 907/1824] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:48.145483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f9f2-7c95-411a-8ccf-52d153883989 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.145851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f9f2-7c95-411a-8ccf-52d153883989 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.146099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f9f2-7c95-411a-8ccf-52d153883989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.169239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e773f9f2-7c95-411a-8ccf-52d153883989 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:48.170492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e773f9f2-7c95-411a-8ccf-52d153883989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.178068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '685857ec77db4bc084c7f27059bcbffd', 'request_id': 'req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:48.186743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '685857ec77db4bc084c7f27059bcbffd', 'request_id': 'req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:48.207251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '685857ec77db4bc084c7f27059bcbffd', 'request_id': 'req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:48.220899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] The token cache is being invalidate because project 685857ec77db4bc084c7f27059bcbffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:48.221253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:48.222107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:48.231013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 918/1825] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:48 2022] DELETE /identity/v3/projects/685857ec77db4bc084c7f27059bcbffd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:48.232198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.234039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.252222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 908/1826] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:48.253356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.253639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.253947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.275928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:48.277242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.288417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 909/1827] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:48.289348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.300050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128aaa-e95c-4ea0-a0ae-95a2d9956b21 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.305508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.306295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.306662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.307396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:48.307527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.308247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:48.308747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.310421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5b340-86f0-4e68-8d36-daf596dfb404 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.332503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 910/1828] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:48.338400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.338763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.339027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.363896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:48.365377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.379195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873e5eb-50bf-4934-a4ec-4a4e0fca869e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.380488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 911/1829] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:48.381396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.391461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.392630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.392963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cbc09-c33d-4817-8b31-bfd617f449dc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.394032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.394322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] PATH_INFO: `/v3/projects/c5d50d27fefb47f284870f15dded7d9f/users/e8d9dcd82f654a7d88d952e476b9dd05/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.398029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.398687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.398933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.399202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.399874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.401810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.415615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d50d27fefb47f284870f15dded7d9f, user_id=e8d9dcd82f654a7d88d952e476b9dd05, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.419066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.435982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 912/1830] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:48.437345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.452138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 919/1831] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:48 2022] PUT /identity/v3/projects/c5d50d27fefb47f284870f15dded7d9f/users/e8d9dcd82f654a7d88d952e476b9dd05/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:48.452138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.536848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b593ae-5dd3-4f80-9595-b815b93d4b44 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.541827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bb7bd-96eb-4b7b-a11e-410bee55ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.542461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bb7bd-96eb-4b7b-a11e-410bee55ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.542742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bb7bd-96eb-4b7b-a11e-410bee55ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.543038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bb7bd-96eb-4b7b-a11e-410bee55ba4f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.543678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bb7bd-96eb-4b7b-a11e-410bee55ba4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.545626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bb7bd-96eb-4b7b-a11e-410bee55ba4f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.580783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 920/1832] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/users => generated 278 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:48.582055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.582331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.582605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.594610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b4ea-5ec0-4338-be94-c2563eae2303 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.604151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.604889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.610132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.611113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.611820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:48.612535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.614147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.655779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] MFA Rules not processed for user `e8d9dcd82f654a7d88d952e476b9dd05`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:48.658324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.658604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 913/1833] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:48.669566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.690802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780895f0-82ec-46c4-bf66-470d387abdee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.696441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.696836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.697116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.697422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.698188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.699799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.714887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 914/1834] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:48.715841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.727238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcfcba-328c-4df1-859a-acceb4be2da9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.733658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.734466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.734584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.734978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.735626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.738892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.784760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 915/1835] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:48.791471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.819779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 921/1836] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:48.819779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.835785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:48.847239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54330d17-ec49-43d3-8948-9e3858cd3964 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.939779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:48.954989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4fb2b-851e-425a-99bf-2296192a3a9e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.964202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.964741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.965041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.965281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.965966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.967612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.985953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 916/1837] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:48.988373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.002438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a7a2e-37ba-47c5-bdb9-06ee7599c53f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.009233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.010134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.010665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.011598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.011896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.012125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.012231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.012687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.012848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.013707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.016002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.016141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.049635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 922/1838] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:49.050758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.050864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 917/1839] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:48 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:49.051704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.053034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.067990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb92fe-f1c1-44aa-bc25-44603c9cfa27 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.132956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56822b81-8e3b-4fe6-b1c9-d10ec7fb1028 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.138720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.139822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.140170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.140466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] PATH_INFO: `/v3/projects/38e2c2e8ea054b54b64c4bad76df2c8a/users/f64133d737ba44f38e06ab823970f903/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.155128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.155790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.156071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.156350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] PATH_INFO: `/v3/users/9de17983ea46421599a8a41baf748786` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.157518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de17983ea46421599a8a41baf748786)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.159737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.164423 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e2c2e8ea054b54b64c4bad76df2c8a, user_id=f64133d737ba44f38e06ab823970f903, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.167839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.191517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 918/1840] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:49 2022] PUT /identity/v3/projects/38e2c2e8ea054b54b64c4bad76df2c8a/users/f64133d737ba44f38e06ab823970f903/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:49.200174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.254309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de17983ea46421599a8a41baf748786'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:49.255047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de17983ea46421599a8a41baf748786'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:49.270985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de17983ea46421599a8a41baf748786'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:49.272284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de17983ea46421599a8a41baf748786'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:49.283832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfc5c-312f-41dd-b275-73d38774779e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.291173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9558-bad4-4057-9386-a0b1dfc05857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.291338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de17983ea46421599a8a41baf748786'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:49.292277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9558-bad4-4057-9386-a0b1dfc05857 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.292960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9558-bad4-4057-9386-a0b1dfc05857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.293405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9558-bad4-4057-9386-a0b1dfc05857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.294362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd9558-bad4-4057-9386-a0b1dfc05857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.296365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd9558-bad4-4057-9386-a0b1dfc05857 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.308029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 923/1841] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:49 2022] DELETE /identity/v3/users/9de17983ea46421599a8a41baf748786 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:49.308875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.309895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 919/1842] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:49.311611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672efd-abf2-4322-974f-81c71c38811d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.311961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672efd-abf2-4322-974f-81c71c38811d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.312254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672efd-abf2-4322-974f-81c71c38811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.314708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.328827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:49.346431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-62672efd-abf2-4322-974f-81c71c38811d None None] MFA Rules not processed for user `f64133d737ba44f38e06ab823970f903`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:49.347834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-62672efd-abf2-4322-974f-81c71c38811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.368765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:49.390303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0930a5-1606-4517-b049-e91feef773da admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.395190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7657f6-8c6e-43c9-ac8d-0ed71d1d6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.395966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7657f6-8c6e-43c9-ac8d-0ed71d1d6cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.396247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7657f6-8c6e-43c9-ac8d-0ed71d1d6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.396517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7657f6-8c6e-43c9-ac8d-0ed71d1d6cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.397300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7657f6-8c6e-43c9-ac8d-0ed71d1d6cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.399292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7657f6-8c6e-43c9-ac8d-0ed71d1d6cf2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.420747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 920/1843] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:49.421609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672efd-abf2-4322-974f-81c71c38811d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.422941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-62672efd-abf2-4322-974f-81c71c38811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.428487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 924/1844] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:49 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:49.428487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.428487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.428487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.436902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672efd-abf2-4322-974f-81c71c38811d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.441511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.442150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.442427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.442692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.443366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.445003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.446953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:49.448164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.455329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 921/1845] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:49.456101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.457847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.458947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 925/1846] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:49.459832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.472356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350416aa-e5ae-44cc-993d-8ef519a68475 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.474978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713ff7-6078-4d29-85fa-7b31afccfe9b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.477887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.478506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.478793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.479053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.479579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.480031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.480192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.480467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.480742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.481387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.482303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.483049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.493098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 926/1847] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:49.493914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.503504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22940cbd-f4d5-47dc-8410-ecef8e89d9bf admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.508392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.509110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.509393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.509667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] PATH_INFO: `/v3/projects/e6e7dcd5527b4bfc9d682cdeb017d382/users/2809c4fad14c42a1b9fb9f0734ce2d3a/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.519784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 922/1848] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:49 2022] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:49.519784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.519784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.524370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e7dcd5527b4bfc9d682cdeb017d382, user_id=2809c4fad14c42a1b9fb9f0734ce2d3a, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.527144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.542133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 927/1849] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:49 2022] PUT /identity/v3/projects/e6e7dcd5527b4bfc9d682cdeb017d382/users/2809c4fad14c42a1b9fb9f0734ce2d3a/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:49.542943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.591176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339a89-4377-4dee-b24f-30cd7c7f875b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.605988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078a6a-6a8e-468a-8fa1-5119322cc2dc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.612292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.613000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.613276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.613532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] PATH_INFO: `/v3/projects/a07936e91eb147f699fd3a1b131fe3fb/users/7676c5e055024057b6407b531eff1f54/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.631151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07936e91eb147f699fd3a1b131fe3fb, user_id=7676c5e055024057b6407b531eff1f54, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.633913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.640739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9c0f-698e-4465-8bef-b49451de6835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.641274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9c0f-698e-4465-8bef-b49451de6835 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.641545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9c0f-698e-4465-8bef-b49451de6835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.641840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9c0f-698e-4465-8bef-b49451de6835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.649103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 928/1850] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:49 2022] PUT /identity/v3/projects/a07936e91eb147f699fd3a1b131fe3fb/users/7676c5e055024057b6407b531eff1f54/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:49.649553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.651110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef9c0f-698e-4465-8bef-b49451de6835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.653807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef9c0f-698e-4465-8bef-b49451de6835 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.665415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 923/1851] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:49.666591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.666875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.667147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.700619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] MFA Rules not processed for user `2809c4fad14c42a1b9fb9f0734ce2d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:49.701932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.717618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:49.741818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba63cce-40bc-4060-95b4-d3f8fb33bab9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.748750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.749402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.750206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.750515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.751294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.755295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.783318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 929/1852] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:49 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:49.784198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.794316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:49.804294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45834-7acf-403f-9a85-9a081b4b1034 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.811468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.812480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.813046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.813152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 924/1853] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:49.813607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.814329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.814682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.816912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.841979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acd8e4-ac03-4eef-9abd-10eb6b0df7fc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.846636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 930/1854] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:49.846636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.848177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:49.848279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.848667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.849239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.849513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.850302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.852121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.874672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 925/1855] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:49.875460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:49.897020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58524-90dc-458f-9b73-483438e38f53 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.902007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:49.902978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:49.904806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:49.905230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] PATH_INFO: `/v3/projects/a07936e91eb147f699fd3a1b131fe3fb/users/7676c5e055024057b6407b531eff1f54/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:49.908270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07936e91eb147f699fd3a1b131fe3fb, user_id=7676c5e055024057b6407b531eff1f54, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:49.911323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:49.924283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 926/1856] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:49 2022] PUT /identity/v3/projects/a07936e91eb147f699fd3a1b131fe3fb/users/7676c5e055024057b6407b531eff1f54/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:49.924903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66db46-ccaf-458e-ae38-7170f0c4884e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:49.925511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.003321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.003983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.004380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.004551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.010306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04e5a3-cc3b-4752-84da-eaa427ce855b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.016615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455aceb-6c90-4b82-95f4-3e53cee1745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.017302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455aceb-6c90-4b82-95f4-3e53cee1745f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.017618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455aceb-6c90-4b82-95f4-3e53cee1745f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.018079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455aceb-6c90-4b82-95f4-3e53cee1745f admin admin] PATH_INFO: `/v3/projects/774f7d9692b04ce4a75d8087ea68ed4b/users/cb6376d2ab9f489584c1bd425a030487/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.042004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455aceb-6c90-4b82-95f4-3e53cee1745f admin admin] RBAC: Authorizing `identity:create_grant(project_id=774f7d9692b04ce4a75d8087ea68ed4b, user_id=cb6376d2ab9f489584c1bd425a030487, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.044925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455aceb-6c90-4b82-95f4-3e53cee1745f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.064800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 927/1857] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:49 2022] PUT /identity/v3/projects/774f7d9692b04ce4a75d8087ea68ed4b/users/cb6376d2ab9f489584c1bd425a030487/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:50.066292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.066645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.067347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.098219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.100353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.102266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] MFA Rules not processed for user `7676c5e055024057b6407b531eff1f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:50.103715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.113516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 931/1858] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:50.114422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.116128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.132145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf235d-f3bb-4838-908f-7bde56284570 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.230444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:50.247762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 928/1859] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:50.249656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.272669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.273436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.273629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.273921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] PATH_INFO: `/v3/projects/10640e0c843c4ac2a5698f69fb29b510` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.277204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10640e0c843c4ac2a5698f69fb29b510)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.280378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.294901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:50.379388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1000-e3a0-4849-a78d-b1ad30fff281 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.382287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10640e0c843c4ac2a5698f69fb29b510', 'request_id': 'req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.391057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10640e0c843c4ac2a5698f69fb29b510', 'request_id': 'req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.402156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10640e0c843c4ac2a5698f69fb29b510', 'request_id': 'req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.428735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] The token cache is being invalidate because project 10640e0c843c4ac2a5698f69fb29b510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:50.429224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.430485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.433146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 932/1860] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:50 2022] DELETE /identity/v3/projects/10640e0c843c4ac2a5698f69fb29b510 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:50.434466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.435957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.473381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.474373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.474888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.475387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.476269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.478493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.494184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 929/1861] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:50.495329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.500323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.517185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359dd7e-372c-4cd0-915c-af0dbb76225a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.524026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.525023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.525442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.525942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] PATH_INFO: `/v3/users/7cb4961ba6794da28deedc8177e55c0a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.527417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb4961ba6794da28deedc8177e55c0a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.529928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.548485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2df49f-c3a7-4cc1-a9a1-96018b8a0227 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.558926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.559875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.560745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.561026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.564338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.640549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb4961ba6794da28deedc8177e55c0a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.664655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb4961ba6794da28deedc8177e55c0a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.665760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb4961ba6794da28deedc8177e55c0a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.698089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.699769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.705047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb4961ba6794da28deedc8177e55c0a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.706115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-def1ac4c-a672-4e91-b700-5e6b2f22a28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb4961ba6794da28deedc8177e55c0a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.720888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 933/1862] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:50.722226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.723912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.732471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 930/1863] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:50 2022] DELETE /identity/v3/users/7cb4961ba6794da28deedc8177e55c0a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:50.733941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4293877-898a-4f66-97af-47b6076579bc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.734222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4293877-898a-4f66-97af-47b6076579bc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.734497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4293877-898a-4f66-97af-47b6076579bc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.743725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2629fa2-6c4c-4543-a7ab-b82eecec42c3 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.749909 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 931/1864] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:54:50 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:50.763461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.764028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.764325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.797303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:50.804996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:50.808765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.822327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:50.834027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0e2b-2855-413d-a51f-730d38e64a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.834366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0e2b-2855-413d-a51f-730d38e64a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.839262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0e2b-2855-413d-a51f-730d38e64a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.840132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0e2b-2855-413d-a51f-730d38e64a43 admin admin] PATH_INFO: `/v3/projects/774f7d9692b04ce4a75d8087ea68ed4b/users/cb6376d2ab9f489584c1bd425a030487/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.858885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0e2b-2855-413d-a51f-730d38e64a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774f7d9692b04ce4a75d8087ea68ed4b, user_id=cb6376d2ab9f489584c1bd425a030487, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.865682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0e2b-2855-413d-a51f-730d38e64a43 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.888006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 934/1865] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:50 2022] PUT /identity/v3/projects/774f7d9692b04ce4a75d8087ea68ed4b/users/cb6376d2ab9f489584c1bd425a030487/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:50.898921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.899464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.905201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.965036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 932/1866] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:50.966587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] MFA Rules not processed for user `cb6376d2ab9f489584c1bd425a030487`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:50.967867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.011533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.013005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.064693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe110-d2f4-4bbe-bab5-69cb011577d8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.109993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 935/1867] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:51.128082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.130841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.204690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.205546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.206030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.206500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.230703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.233184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.253290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedbba4-c016-49d8-89a8-7063b44cc4b8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.258508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.259231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.259586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.259983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.261087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 933/1868] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:51.263544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.266171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.271837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.273876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.287626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 936/1869] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:51.318375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.320913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.402002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b71ccc-efac-4b84-9c9d-3a84357fd69b service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.430310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7676c5e055024057b6407b531eff1f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a07936e91eb147f699fd3a1b131fe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.430310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.430710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.431013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.431610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:51.432244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.438023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.469704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 934/1870] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:51.471986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.497298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346333d1-9000-4c95-b6bd-d429ee72df12 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.508948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.509919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.510185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.510673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.516226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.520701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8729181-f23d-4f43-b4cf-20493fb40431 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.537373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.538101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.538425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.538683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] PATH_INFO: `/v3/projects/91e127c5e1bb44989a97de803c8d8ecb` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.543477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e127c5e1bb44989a97de803c8d8ecb)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.547049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.556602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:51.571779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:51.638531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.640673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.650203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e127c5e1bb44989a97de803c8d8ecb', 'request_id': 'req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:51.654581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 935/1871] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:51.655664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.668846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f39235-45e2-4aea-a278-260630986054 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.677267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e127c5e1bb44989a97de803c8d8ecb', 'request_id': 'req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:51.702722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e127c5e1bb44989a97de803c8d8ecb', 'request_id': 'req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:51.740495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] The token cache is being invalidate because project 91e127c5e1bb44989a97de803c8d8ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:51.741810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:51.749625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-016464f1-f5c5-4fda-b7eb-6a62b9fd6207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:51.757060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 937/1872] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:51 2022] DELETE /identity/v3/projects/91e127c5e1bb44989a97de803c8d8ecb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:51.759716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7943-d2c0-4bdb-b523-b4f367e890bd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.760705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7943-d2c0-4bdb-b523-b4f367e890bd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.761309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7943-d2c0-4bdb-b523-b4f367e890bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.791931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-488b7943-d2c0-4bdb-b523-b4f367e890bd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:51.793804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-488b7943-d2c0-4bdb-b523-b4f367e890bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.834012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7676c5e055024057b6407b531eff1f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a07936e91eb147f699fd3a1b131fe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.834012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.834012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.834461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.834832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.836750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.908788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 936/1873] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:51 2022] POST /identity/v3/projects => generated 354 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:51.913631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.919431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.958250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 938/1874] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:51.973255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.974195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.975131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.032828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:52.035016 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.089215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a17d56-8ee7-4f9a-a07e-d40d56fea541 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.097577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7676c5e055024057b6407b531eff1f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a07936e91eb147f699fd3a1b131fe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.099257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.099779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.100147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.100992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:52.101368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.103431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.128983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 937/1875] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:52.203421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 939/1876] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:52.206673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.206811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.218966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f2e8-ddfa-4575-b2af-8d69075f3d7e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.224451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75736-2454-4756-90bd-dc22cd71db52 tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.225676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.226425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.226861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.227304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.228039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:52.228402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.231071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.238682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7676c5e055024057b6407b531eff1f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a07936e91eb147f699fd3a1b131fe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.239347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.239630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.239904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] PATH_INFO: `/v3/projects/274ec7cea6c24144bdd8fb4f915c1691` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.241508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorizing `identity:delete_project(project_id=274ec7cea6c24144bdd8fb4f915c1691)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.243467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.251864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 940/1877] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:52.253294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.265825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b391372-a9d3-481a-9997-a80d50afdcda admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.272130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.272744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.273262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.273589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.274618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.286023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.303687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.318894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274ec7cea6c24144bdd8fb4f915c1691', 'request_id': 'req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.326397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 941/1878] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:52.327719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274ec7cea6c24144bdd8fb4f915c1691', 'request_id': 'req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.334495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.337228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274ec7cea6c24144bdd8fb4f915c1691', 'request_id': 'req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.340828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.352156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] The token cache is being invalidate because project 274ec7cea6c24144bdd8fb4f915c1691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:52.352455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.353269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.355976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 938/1879] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:52 2022] DELETE /identity/v3/projects/274ec7cea6c24144bdd8fb4f915c1691 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:52.417175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ead08e-c3fd-4a09-b650-df8b242b49c2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.422189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.422849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.423163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.423435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.424234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.426591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.451238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 942/1880] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:52.455933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.457501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.526465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab94f7a-bd29-4715-ad6c-e5d417ab999d tempest-VolumeQuotaClassesTest-1131619027 tempest-VolumeQuotaClassesTest-1131619027-project-admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.531793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.532402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.532675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.532943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.534128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.536050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.547131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 939/1881] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:52.550926 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.561558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488840a2-e0de-457c-b6c0-4ebd9be1111b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.567737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.568541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.569257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.569537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.569653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.569838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.570478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.572112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.582239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7cbe4-bf0f-4572-a1b5-d4f3059d8950 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.585570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 943/1882] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:52.586596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.586957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.587584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.587860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.588133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] PATH_INFO: `/v3/users/e8d9dcd82f654a7d88d952e476b9dd05` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.589259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d9dcd82f654a7d88d952e476b9dd05)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.591205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.596451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecf33c-6321-46d1-bdb6-bca2898258e1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.601068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be044754-af3e-4164-b1cd-251254979f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.601722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be044754-af3e-4164-b1cd-251254979f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.602039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be044754-af3e-4164-b1cd-251254979f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.602319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be044754-af3e-4164-b1cd-251254979f21 admin admin] PATH_INFO: `/v3/projects/55acbd0dbab245fca321315681ffb62e/users/65b0873073124199b51dea6ae93e28fb/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.618091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be044754-af3e-4164-b1cd-251254979f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55acbd0dbab245fca321315681ffb62e, user_id=65b0873073124199b51dea6ae93e28fb, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.620861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be044754-af3e-4164-b1cd-251254979f21 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.637331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 944/1883] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:52 2022] PUT /identity/v3/projects/55acbd0dbab245fca321315681ffb62e/users/65b0873073124199b51dea6ae93e28fb/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:52.644286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d9dcd82f654a7d88d952e476b9dd05'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.648887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.649177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.649452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.653518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d9dcd82f654a7d88d952e476b9dd05'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.654307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d9dcd82f654a7d88d952e476b9dd05'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.670167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d9dcd82f654a7d88d952e476b9dd05'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.671198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-28f33cbd-99ac-4f61-b979-76fbe84506cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d9dcd82f654a7d88d952e476b9dd05'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.678594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] MFA Rules not processed for user `65b0873073124199b51dea6ae93e28fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:52.679971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.687570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 940/1884] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:52 2022] DELETE /identity/v3/users/e8d9dcd82f654a7d88d952e476b9dd05 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:52.691658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.691945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.692218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.712840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:52.714067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.748309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.770542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 945/1885] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:52.774992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.777053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.801160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 941/1886] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:52.814350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.815747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.841896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.867774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d4b9-397d-4cf0-8ccb-f934f2445cb1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.872863 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.873672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.873984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.874849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.875498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.877509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.883777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00b7b6-9a19-4099-af16-830935028872 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.888739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.889398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.890085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.891147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.902230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.903661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.916494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 946/1887] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:52.916641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 942/1888] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:52.917498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.983565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a1213-466d-49bc-9d27-4add8b3420cd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.988487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.989187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.989408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.989680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.990363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.992343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.016843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 947/1889] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:53.022151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.033763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbcea5-6f4a-4394-aff0-fc3f367a80ce service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.038869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.039473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.039775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.040052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.040818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.042651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.053901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 943/1890] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:53.060068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.076242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f510f-2518-4115-9dca-325219564f57 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.082410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.083601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.083601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.083876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] PATH_INFO: `/v3/projects/52485553c9e549dab0606fca1cd8c147/users/c0936f5c83944e42bca55751ba7eb674/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.111198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52485553c9e549dab0606fca1cd8c147, user_id=c0936f5c83944e42bca55751ba7eb674, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.114007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.130822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 948/1891] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:53 2022] PUT /identity/v3/projects/52485553c9e549dab0606fca1cd8c147/users/c0936f5c83944e42bca55751ba7eb674/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:53.136146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.149697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e27ac-f5e0-4cfc-9205-ef6c25394e0b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.242510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.243319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.244148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.244148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.244820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.246687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.261589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 944/1892] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:53.270763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.273308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.275083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.288476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a780f-bec4-4d7a-9e51-27f897fecec4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.291485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352684bf-80dd-4b8c-854b-590a202a1558 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.297594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.298372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.298711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.299088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] PATH_INFO: `/v3/projects/c5d50d27fefb47f284870f15dded7d9f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.300245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d50d27fefb47f284870f15dded7d9f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.302509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.313938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311cc9d-867e-4097-b2b9-31a587930bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.314645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311cc9d-867e-4097-b2b9-31a587930bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.314962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311cc9d-867e-4097-b2b9-31a587930bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.315242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311cc9d-867e-4097-b2b9-31a587930bd5 admin admin] PATH_INFO: `/v3/projects/52485553c9e549dab0606fca1cd8c147/users/c0936f5c83944e42bca55751ba7eb674/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.322515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311cc9d-867e-4097-b2b9-31a587930bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52485553c9e549dab0606fca1cd8c147, user_id=c0936f5c83944e42bca55751ba7eb674, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.325253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311cc9d-867e-4097-b2b9-31a587930bd5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.351050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 949/1893] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:53 2022] PUT /identity/v3/projects/52485553c9e549dab0606fca1cd8c147/users/c0936f5c83944e42bca55751ba7eb674/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:53.368089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.368307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.368570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.391082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d50d27fefb47f284870f15dded7d9f', 'request_id': 'req-009008b8-1904-424d-b47b-43ad02180fb9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.398832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d50d27fefb47f284870f15dded7d9f', 'request_id': 'req-009008b8-1904-424d-b47b-43ad02180fb9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.400568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:53.407409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] MFA Rules not processed for user `c0936f5c83944e42bca55751ba7eb674`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:53.408945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d50d27fefb47f284870f15dded7d9f', 'request_id': 'req-009008b8-1904-424d-b47b-43ad02180fb9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.410780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.422325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] The token cache is being invalidate because project c5d50d27fefb47f284870f15dded7d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:53.422752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.423460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.428149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 945/1894] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:53 2022] DELETE /identity/v3/projects/c5d50d27fefb47f284870f15dded7d9f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:53.431461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.434258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.506282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 950/1895] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:53.514197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.515292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009008b8-1904-424d-b47b-43ad02180fb9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.515997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.520300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.520972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.521245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.521689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] PATH_INFO: `/v3/users/7676c5e055024057b6407b531eff1f54` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.522877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7676c5e055024057b6407b531eff1f54)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.524837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.528342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:53.584134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7676c5e055024057b6407b531eff1f54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.585338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477882c-3d30-4db2-9ee6-bd0c3b13643f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.590019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.590653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.590935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.591248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.595709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7676c5e055024057b6407b531eff1f54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.596362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7676c5e055024057b6407b531eff1f54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.603995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.605478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.608956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7676c5e055024057b6407b531eff1f54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.609677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7676c5e055024057b6407b531eff1f54'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.615239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 951/1896] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:53.622347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 946/1897] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:53 2022] DELETE /identity/v3/users/7676c5e055024057b6407b531eff1f54 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:53.944556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.960008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca647e4-0036-46a4-bb56-b18a9805d379 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.037368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.038327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.038674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.039025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] PATH_INFO: `/v3/projects/a07936e91eb147f699fd3a1b131fe3fb` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.043189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07936e91eb147f699fd3a1b131fe3fb)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.043189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.062219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.063893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.078193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260057f5-ea5b-4080-b21a-d57eda7aa94e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.083765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.085610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.085610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.085610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] PATH_INFO: `/v3/users/65b0873073124199b51dea6ae93e28fb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.086623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b0873073124199b51dea6ae93e28fb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.088559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.106215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07936e91eb147f699fd3a1b131fe3fb', 'request_id': 'req-36ac0b53-f031-4662-9be2-5fc0f285c6b5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.119506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07936e91eb147f699fd3a1b131fe3fb', 'request_id': 'req-36ac0b53-f031-4662-9be2-5fc0f285c6b5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.133386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07936e91eb147f699fd3a1b131fe3fb', 'request_id': 'req-36ac0b53-f031-4662-9be2-5fc0f285c6b5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.152798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] The token cache is being invalidate because project a07936e91eb147f699fd3a1b131fe3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:54.153102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.153995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36ac0b53-f031-4662-9be2-5fc0f285c6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.155760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 952/1898] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:53 2022] DELETE /identity/v3/projects/a07936e91eb147f699fd3a1b131fe3fb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:54.163051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c1f9-e9ee-488b-9772-b1b6aa809f6c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.163328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c1f9-e9ee-488b-9772-b1b6aa809f6c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.163610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c1f9-e9ee-488b-9772-b1b6aa809f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.180331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b0873073124199b51dea6ae93e28fb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.185091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6066c1f9-e9ee-488b-9772-b1b6aa809f6c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:54.186507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6066c1f9-e9ee-488b-9772-b1b6aa809f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.191123 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b0873073124199b51dea6ae93e28fb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.191999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b0873073124199b51dea6ae93e28fb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.194215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=3,keystone:DELETE=21,keystone:SELECT=76 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:54.207957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b0873073124199b51dea6ae93e28fb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.208777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c941af2f-f9b6-4b8b-bfe8-c1d2ab8ac23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b0873073124199b51dea6ae93e28fb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:54.223982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 947/1899] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:54 2022] DELETE /identity/v3/users/65b0873073124199b51dea6ae93e28fb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:54.229309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.229686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.231219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.237309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:54.252707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:54.253969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.263846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 953/1900] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:54.271743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607429-ccee-4aac-b302-8f48e988698f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.272324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607429-ccee-4aac-b302-8f48e988698f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.272324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607429-ccee-4aac-b302-8f48e988698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.291796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-43607429-ccee-4aac-b302-8f48e988698f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:54.292999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-43607429-ccee-4aac-b302-8f48e988698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.316912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 948/1901] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:54.330740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.332312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.357699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 954/1902] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:54.363030 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607429-ccee-4aac-b302-8f48e988698f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.372541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607429-ccee-4aac-b302-8f48e988698f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.377362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.378024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.378310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.378578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.379272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:54.379580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.381264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.397816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 955/1903] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:54:54.400186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.402539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d4993-632c-4b90-b362-ad56fe06b463 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.406539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.407614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.407614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.407810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.411513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e49e2-405b-4b86-8f10-ae18eb287628 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.417994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.418157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.418594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.418918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.419137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.419910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.420035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.421694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.429381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 949/1904] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:54.457821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 956/1905] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:54.462869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.475450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a300d9-6bbd-402e-98aa-58450a89ec16 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.548477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.549194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.549464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.549825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.550438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.552742 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.582448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 950/1906] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:54.586733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.597896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87170cf4-381f-4a3a-8552-f4b6abbb6661 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.603640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.604291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.604527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.604798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.605439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.607371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.621913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 957/1907] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:54.623715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.640330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e3acf-698a-4159-8b75-c2d6ddc80815 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.647970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45a5e5-fc8b-46bd-92b5-d95a2ddfce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.648982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45a5e5-fc8b-46bd-92b5-d95a2ddfce47 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.649556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45a5e5-fc8b-46bd-92b5-d95a2ddfce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.650040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45a5e5-fc8b-46bd-92b5-d95a2ddfce47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.651851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45a5e5-fc8b-46bd-92b5-d95a2ddfce47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.653919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45a5e5-fc8b-46bd-92b5-d95a2ddfce47 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.656169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:54.672630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 951/1908] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:54.677380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.690225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acbd3d-825e-4ef3-8e94-16e423ee500f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.696279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.697290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.698226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.698766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] PATH_INFO: `/v3/projects/8d1e7512e0aa419a97d54a5e529854f7/users/939c1e2ae88b4eb2a38394d0218a0475/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.719667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1e7512e0aa419a97d54a5e529854f7, user_id=939c1e2ae88b4eb2a38394d0218a0475, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.722977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.760877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 958/1909] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:54 2022] PUT /identity/v3/projects/8d1e7512e0aa419a97d54a5e529854f7/users/939c1e2ae88b4eb2a38394d0218a0475/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:54.763088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.763369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.763639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.816087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] MFA Rules not processed for user `939c1e2ae88b4eb2a38394d0218a0475`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:54.817574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.903108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 952/1910] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:54.907610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.975188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce8a1-7e19-4bd4-abdf-c263005a2ef7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.980248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.980887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.981303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.981580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.982254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.984221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.006363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:55.015369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 959/1911] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:55.019385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.036774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2294b-c567-418a-9184-c368e6c6130f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.091722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.094022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:55.119422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.120195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.120606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.120883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.121707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.123754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.160571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 953/1912] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:55 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:55.161627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.177279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1ab5-0483-4f03-925b-0611d0365304 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.184797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.185713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.186087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.186366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.188234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.190362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.191248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba1a6c-9e38-4379-ad5d-b57b0ca5abcb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.197962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.198771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.199123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.199451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] PATH_INFO: `/v3/projects/55acbd0dbab245fca321315681ffb62e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.201174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55acbd0dbab245fca321315681ffb62e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.204134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.231445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 954/1913] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:55.235915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.250117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8842a-9a2a-44f1-91fb-f5d8ae68e9f3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.263703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.265946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.266498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.267036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.268109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.270737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.298187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 955/1914] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:55.300426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.305567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55acbd0dbab245fca321315681ffb62e', 'request_id': 'req-003943d7-3f69-49d2-b2a6-72a07fc238c9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.312929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf136fa-357d-4211-a857-2c2d241ffee7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.314583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55acbd0dbab245fca321315681ffb62e', 'request_id': 'req-003943d7-3f69-49d2-b2a6-72a07fc238c9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.330272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55acbd0dbab245fca321315681ffb62e', 'request_id': 'req-003943d7-3f69-49d2-b2a6-72a07fc238c9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.346674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] The token cache is being invalidate because project 55acbd0dbab245fca321315681ffb62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:55.346971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.347680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.349508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 960/1915] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:55 2022] DELETE /identity/v3/projects/55acbd0dbab245fca321315681ffb62e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:55.355368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.356920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:55.414065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:55.434142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae4d74-8b6f-4f92-9f5f-d13975d91085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.436461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae4d74-8b6f-4f92-9f5f-d13975d91085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.436980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae4d74-8b6f-4f92-9f5f-d13975d91085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.437973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae4d74-8b6f-4f92-9f5f-d13975d91085 admin admin] PATH_INFO: `/v3/projects/167b2b5f619842aa8ed78491f0686109/users/a4e07a7cedf2454982a49145d2ba6eba/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.460543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae4d74-8b6f-4f92-9f5f-d13975d91085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167b2b5f619842aa8ed78491f0686109, user_id=a4e07a7cedf2454982a49145d2ba6eba, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.464607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae4d74-8b6f-4f92-9f5f-d13975d91085 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.494919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 956/1916] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:55 2022] PUT /identity/v3/projects/167b2b5f619842aa8ed78491f0686109/users/a4e07a7cedf2454982a49145d2ba6eba/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:55.497052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.497399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.497732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.526084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003943d7-3f69-49d2-b2a6-72a07fc238c9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.533388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] MFA Rules not processed for user `a4e07a7cedf2454982a49145d2ba6eba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:55.535302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:55.602325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:55.620242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 957/1917] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:55.624815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.627627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:55.643264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.644003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.644291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.644563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] PATH_INFO: `/v3/users/c0936f5c83944e42bca55751ba7eb674` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.645728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0936f5c83944e42bca55751ba7eb674)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.648131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.705574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0936f5c83944e42bca55751ba7eb674'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.706495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0936f5c83944e42bca55751ba7eb674'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.706627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934fee-d31b-4f70-b75a-31c8cf5e9a76 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.711588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.712297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.712573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.712877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.713650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.715701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0936f5c83944e42bca55751ba7eb674'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.716320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.716692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0936f5c83944e42bca55751ba7eb674'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.731497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0936f5c83944e42bca55751ba7eb674'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:55.746338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 958/1918] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:55 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:55.748287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 961/1919] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:55 2022] DELETE /identity/v3/users/c0936f5c83944e42bca55751ba7eb674 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:55.750548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:55.755279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:55.815083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:55.840345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0a00-0973-49cc-aa37-67fc684462e7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:55.944129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:55.945071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:55.945476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:55.945904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:55.946737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:55.950188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:55.985847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 959/1920] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:55 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:55.988112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.002377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697104-3454-460d-a6e8-2df2c91a2d89 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.007806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.008438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.008719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.009190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.010006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.011637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.027362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 962/1921] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:56.027538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.037557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811c83d-9213-4a9f-9068-540d8085dbec admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.042425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.043092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.043370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.043641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] PATH_INFO: `/v3/projects/670f1f9c93eb4d99924aa7cf0e8fde2f/users/9b8beddc04d7448ca5dff16a3cfbd461/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.060896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670f1f9c93eb4d99924aa7cf0e8fde2f, user_id=9b8beddc04d7448ca5dff16a3cfbd461, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.063965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.081406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 960/1922] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:56 2022] PUT /identity/v3/projects/670f1f9c93eb4d99924aa7cf0e8fde2f/users/9b8beddc04d7448ca5dff16a3cfbd461/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:56.085513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.096549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175010f-8430-4dc0-931e-18031a26f76b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.174296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.175882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.176094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:56.176879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.177370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.177884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.178710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.180541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.193346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8685d-2a59-4b44-b0de-7b6778975c83 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.213571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 963/1923] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:56.217725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.222537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.223312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.223789 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.224069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] PATH_INFO: `/v3/projects/52485553c9e549dab0606fca1cd8c147` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.225522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52485553c9e549dab0606fca1cd8c147)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.227657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.240306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26681c6e-3692-41f4-9597-3b4adf0ab77a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.245564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a2574-b18a-4e7e-82bf-f56d096ac451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.246376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2574-b18a-4e7e-82bf-f56d096ac451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.246764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2574-b18a-4e7e-82bf-f56d096ac451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.247142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2574-b18a-4e7e-82bf-f56d096ac451 admin admin] PATH_INFO: `/v3/projects/670f1f9c93eb4d99924aa7cf0e8fde2f/users/9b8beddc04d7448ca5dff16a3cfbd461/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.249738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a2574-b18a-4e7e-82bf-f56d096ac451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670f1f9c93eb4d99924aa7cf0e8fde2f, user_id=9b8beddc04d7448ca5dff16a3cfbd461, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.252731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a2574-b18a-4e7e-82bf-f56d096ac451 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.274012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 964/1924] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:56 2022] PUT /identity/v3/projects/670f1f9c93eb4d99924aa7cf0e8fde2f/users/9b8beddc04d7448ca5dff16a3cfbd461/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:56.285358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.286716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.286808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.308521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52485553c9e549dab0606fca1cd8c147', 'request_id': 'req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:56.315631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52485553c9e549dab0606fca1cd8c147', 'request_id': 'req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:56.328015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52485553c9e549dab0606fca1cd8c147', 'request_id': 'req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:56.330914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] MFA Rules not processed for user `9b8beddc04d7448ca5dff16a3cfbd461`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:56.333608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:56.344543 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] The token cache is being invalidate because project 52485553c9e549dab0606fca1cd8c147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:56.345075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:56.345838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e98dd956-5291-4ea1-9d33-fa81ddc63b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:56.348335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 961/1925] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:56 2022] DELETE /identity/v3/projects/52485553c9e549dab0606fca1cd8c147 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:56.350734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:56.354993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823702bb-e0a6-4eaa-9328-a38fd2ff6c2d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.355478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823702bb-e0a6-4eaa-9328-a38fd2ff6c2d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.355995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823702bb-e0a6-4eaa-9328-a38fd2ff6c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.395237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-823702bb-e0a6-4eaa-9328-a38fd2ff6c2d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:56.396867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-823702bb-e0a6-4eaa-9328-a38fd2ff6c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:56.442733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 965/1926] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:56.455001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.456667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:56.478391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:56.510019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 962/1927] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:56.519710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.520148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.520662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.532108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4213c5-db81-4b27-ad65-97d8549e8962 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.536406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.538124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.538416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.538941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.545417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:56.547315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:56.550587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.552461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.562225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 963/1928] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:56.567397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.572558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 966/1929] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:56.580418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8549-e912-4454-9b50-763ecdfd8fdf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.585859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.586592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.586937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.587271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.588079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:56.588604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.590411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.612050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 964/1930] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:54:56.620274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.635348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8405-10b5-4b19-9c5a-ea6d61c490fb service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.640334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.641211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.641597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.641984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.642646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.644710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.681078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 967/1931] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:56 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:56.682957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.693320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486098eb-20e6-44b1-be4f-c7c2b1d50bfc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.752640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.754456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.754801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.755125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.755809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.757967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.784643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 965/1932] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:56 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:56.785740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.796531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597ed5-7831-4d9d-87b7-d528391dd570 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.802026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.802754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.803125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.803593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.804363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.806274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.820418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 968/1933] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:56.823069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.837797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e799712-cfa1-4dfa-93a7-26aba552ecab admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.845303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab26eab-ec19-44ae-b180-617cb1373fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.846137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab26eab-ec19-44ae-b180-617cb1373fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.846409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab26eab-ec19-44ae-b180-617cb1373fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.847311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab26eab-ec19-44ae-b180-617cb1373fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.847969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab26eab-ec19-44ae-b180-617cb1373fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.849951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab26eab-ec19-44ae-b180-617cb1373fd9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.862667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 966/1934] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:56.867127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:56.877509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e41ca-fc93-46da-97a9-f31288c0fc6c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:56.882833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:56.883497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.883822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.884094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] PATH_INFO: `/v3/projects/7cc6b5ced06647a3a2e75cb721ac65fa/users/2e7982312721497ca689acf2211f8b65/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.899341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6b5ced06647a3a2e75cb721ac65fa, user_id=2e7982312721497ca689acf2211f8b65, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:56.902111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:56.916236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 969/1935] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:56 2022] PUT /identity/v3/projects/7cc6b5ced06647a3a2e75cb721ac65fa/users/2e7982312721497ca689acf2211f8b65/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:56.926663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:56.926944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:56.927213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:56.961351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] MFA Rules not processed for user `2e7982312721497ca689acf2211f8b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:56.962880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:57.050111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 967/1936] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:57.055361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.125932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:57.130286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b4ae-d949-414a-b3cf-7e272ec1430a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.136183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.137209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.137489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.137760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.138421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.140451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.158225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.170291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 970/1937] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:57 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:57.174708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.203472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:57.233406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44864f7-86ba-4325-8ff8-6ed9cb425315 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.254097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b608ea-4fca-446c-9fa9-d2ae2b9ac4c3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.260683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.261409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.261758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.262125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.262834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.265353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.291371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.291626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.291755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.292131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.293911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:57.295019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 971/1938] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:57 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:57.295861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.306035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc95c-e676-4237-9e70-2fbcd6b87ae2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.311583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.312198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.312477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.312750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.313393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.315089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.326380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 972/1939] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:57.330886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.341554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9871cc-a46e-4c9b-9aa5-32520a02135d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.348988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.349661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.350032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.350313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] PATH_INFO: `/v3/projects/85c7f30efb404909843eff752ed678ce/users/8c709b46ce0948ab948530ca0cbc4e3f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.367168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c7f30efb404909843eff752ed678ce, user_id=8c709b46ce0948ab948530ca0cbc4e3f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.370014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.380330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.381847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.383821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 973/1940] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:57 2022] PUT /identity/v3/projects/85c7f30efb404909843eff752ed678ce/users/8c709b46ce0948ab948530ca0cbc4e3f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:57.387809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.391485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 968/1941] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:57.456704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e19a3b-7360-43ed-8bc0-08c7ffac7ebb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.461519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c17e2-6dd0-4e5a-9c5c-d8f3e7b902ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.462278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c17e2-6dd0-4e5a-9c5c-d8f3e7b902ad admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.462557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c17e2-6dd0-4e5a-9c5c-d8f3e7b902ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.462824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c17e2-6dd0-4e5a-9c5c-d8f3e7b902ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.463500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c17e2-6dd0-4e5a-9c5c-d8f3e7b902ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.465128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c17e2-6dd0-4e5a-9c5c-d8f3e7b902ad admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.476072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 974/1942] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:57.481122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.492643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6363d0d-9c4f-4de5-991a-e15165afa481 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.497679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.498416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.498692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.498978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] PATH_INFO: `/v3/projects/85c7f30efb404909843eff752ed678ce/users/8c709b46ce0948ab948530ca0cbc4e3f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.500914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c7f30efb404909843eff752ed678ce, user_id=8c709b46ce0948ab948530ca0cbc4e3f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.503785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.515061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 969/1943] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:57 2022] PUT /identity/v3/projects/85c7f30efb404909843eff752ed678ce/users/8c709b46ce0948ab948530ca0cbc4e3f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:57.527277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.527914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.529129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.562284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] MFA Rules not processed for user `8c709b46ce0948ab948530ca0cbc4e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:57.563527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:57.589753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:57.653363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 975/1944] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:57.673908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.803147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4a2c-257d-46ac-9d30-126653ce1ad9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.807667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457498-06f8-4073-9468-8c2c3a5d2ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.808289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457498-06f8-4073-9468-8c2c3a5d2ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.808562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457498-06f8-4073-9468-8c2c3a5d2ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.808830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457498-06f8-4073-9468-8c2c3a5d2ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.902265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:57.920482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457498-06f8-4073-9468-8c2c3a5d2ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.922397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457498-06f8-4073-9468-8c2c3a5d2ea4 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.934937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 970/1945] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:01.557730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:01.663080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697b3d8-a10b-4374-a930-9db8d7c9b442 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:01.675158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:01.675825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:01.676103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:01.676378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] PATH_INFO: `/v3/users/2e7982312721497ca689acf2211f8b65` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:01.678047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7982312721497ca689acf2211f8b65)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:01.681041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:01.770348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7982312721497ca689acf2211f8b65'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:01.771728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7982312721497ca689acf2211f8b65'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:01.780976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7982312721497ca689acf2211f8b65'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:01.781914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7982312721497ca689acf2211f8b65'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:01.797791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7982312721497ca689acf2211f8b65'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:01.817327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 976/1946] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:01 2022] DELETE /identity/v3/users/2e7982312721497ca689acf2211f8b65 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:01.821921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:01.822372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:01.822642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:01.870710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:01.871946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:01.954794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 971/1947] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:01.995629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:01.998410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:02.055962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:02.075975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb321b-9e5f-4746-8f58-3a5451e0e7d3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:02.079705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:02.080349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:02.080624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:02.080896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:02.091590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:02.093446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:02.107043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 977/1948] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:02.717562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:02.721638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:02.736969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3fa10-8654-4eae-aece-74883e8e53d6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:02.745015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:02.745728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:02.746057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:02.746338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] PATH_INFO: `/v3/projects/7cc6b5ced06647a3a2e75cb721ac65fa` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:02.747561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc6b5ced06647a3a2e75cb721ac65fa)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:02.757373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:02.899067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc6b5ced06647a3a2e75cb721ac65fa', 'request_id': 'req-9679d336-a773-4753-b31b-3f2bb77b8699'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:02.910218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc6b5ced06647a3a2e75cb721ac65fa', 'request_id': 'req-9679d336-a773-4753-b31b-3f2bb77b8699'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:02.924365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc6b5ced06647a3a2e75cb721ac65fa', 'request_id': 'req-9679d336-a773-4753-b31b-3f2bb77b8699'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:02.956555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] The token cache is being invalidate because project 7cc6b5ced06647a3a2e75cb721ac65fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:02.957317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:02.957781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:02.959665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 972/1949] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:02 2022] DELETE /identity/v3/projects/7cc6b5ced06647a3a2e75cb721ac65fa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:02.963786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:02.976054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8cf5-4d38-40c5-95c2-c0c24296b0db service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:03.080630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:03.081428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.081709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.082026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] PATH_INFO: `/v3/users/8c709b46ce0948ab948530ca0cbc4e3f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:03.083153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c709b46ce0948ab948530ca0cbc4e3f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:03.085135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:03.163808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c709b46ce0948ab948530ca0cbc4e3f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.165204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c709b46ce0948ab948530ca0cbc4e3f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.168551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:03.172987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:03.177855 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c709b46ce0948ab948530ca0cbc4e3f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.178839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c709b46ce0948ab948530ca0cbc4e3f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.213233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c709b46ce0948ab948530ca0cbc4e3f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.232161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 978/1950] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:02 2022] DELETE /identity/v3/users/8c709b46ce0948ab948530ca0cbc4e3f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:03.277258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d336-a773-4753-b31b-3f2bb77b8699 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:03.324294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:03.366586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:03.367491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.367938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.369064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:03.371225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:03.497107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:03.498616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5606d-d0e3-4790-8f76-40a9799cdc12 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:03.520276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 973/1951] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:03.673633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:03.675232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:03.798349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beceb8-8641-4d5d-8494-93e9a4a7635f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:03.806625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:03.808057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.808489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.808965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] PATH_INFO: `/v3/projects/85c7f30efb404909843eff752ed678ce` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:03.810884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c7f30efb404909843eff752ed678ce)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:03.813425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:03.815689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:03.925503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c7f30efb404909843eff752ed678ce', 'request_id': 'req-41af348b-c4a9-424e-a914-61f2377097d9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.939355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c7f30efb404909843eff752ed678ce', 'request_id': 'req-41af348b-c4a9-424e-a914-61f2377097d9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.958589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c7f30efb404909843eff752ed678ce', 'request_id': 'req-41af348b-c4a9-424e-a914-61f2377097d9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.970776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] The token cache is being invalidate because project 85c7f30efb404909843eff752ed678ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:03.971456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.971696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41af348b-c4a9-424e-a914-61f2377097d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:03.977484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 979/1952] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:03 2022] DELETE /identity/v3/projects/85c7f30efb404909843eff752ed678ce => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:03.979371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.979863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.979958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.004610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:04.006843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:04.114934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 974/1953] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:04.124402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.124657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.124934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.149965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:04.151243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:04.165076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 980/1954] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:04.166572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.181162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639010c-bf4a-4dd2-beac-1da5afcf0469 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.202316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.203235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.203235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.203530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.204143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:04.204446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.206111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.220983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 975/1955] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:55:04.225646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.236630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acf2ef-9cca-4a44-8285-e5017df8bc24 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.241957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.242769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.243225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.243681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.244812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.247036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.298430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 981/1956] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:04.299119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.310254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53637486-58c9-4aab-9377-09ae4cf43170 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.394539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.395457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.395885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.396298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.397142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.411266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.433461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:04.447385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 976/1957] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:04.448699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.463467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033e99f-b8cb-4f09-bf71-7395c918eb76 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.470782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.471610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.472636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.473089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.473917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.476491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.506906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.507410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 982/1958] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:04.517639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306fb2-c432-443a-ba6b-a6a19dfca08a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.523480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e10b9-7ba7-4e9b-9d36-57bb443681fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.524650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e10b9-7ba7-4e9b-9d36-57bb443681fb admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.525070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e10b9-7ba7-4e9b-9d36-57bb443681fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.526102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e10b9-7ba7-4e9b-9d36-57bb443681fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.526813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e10b9-7ba7-4e9b-9d36-57bb443681fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.528714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e10b9-7ba7-4e9b-9d36-57bb443681fb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.563167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 977/1959] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:04.564559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.578737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21887e7c-0eba-4e8a-8015-8586892eae1a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.589018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.590493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.591267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.592514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] PATH_INFO: `/v3/projects/d457155f4c9040dbad6ecdd17e9d47c7/users/85572d315fef4ff8828b12d72e292772/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.622775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d457155f4c9040dbad6ecdd17e9d47c7, user_id=85572d315fef4ff8828b12d72e292772, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.626468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.648821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 983/1960] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:04 2022] PUT /identity/v3/projects/d457155f4c9040dbad6ecdd17e9d47c7/users/85572d315fef4ff8828b12d72e292772/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:04.659685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.660406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.660689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.698111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] MFA Rules not processed for user `85572d315fef4ff8828b12d72e292772`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:04.699698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:04.794082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 978/1961] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:04.795655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.871521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12389b-ddb3-4473-849d-ad58852e7925 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.877834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.878428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.878778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.879122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.879913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.882357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.930108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 984/1962] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:04.934697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.951041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86835-a9e5-4ddc-8015-3d1bb5d6d259 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.087877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.088525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.088803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.089069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.089724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.091827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.125455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 979/1963] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:05.127069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.137908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163094c9-7dc2-4ee3-8954-0aeb5b71fce8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.142974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.143597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.143874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.144148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.144798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.146454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.152478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:05.158906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 985/1964] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:05.165478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.177648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157af99-c4c7-4532-9fda-815e8b1ef04d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.182790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd88c-5e7a-4ef3-8176-10e33d9a8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.183422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd88c-5e7a-4ef3-8176-10e33d9a8712 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.183691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd88c-5e7a-4ef3-8176-10e33d9a8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.183959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd88c-5e7a-4ef3-8176-10e33d9a8712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.184595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd88c-5e7a-4ef3-8176-10e33d9a8712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.186270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd88c-5e7a-4ef3-8176-10e33d9a8712 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.197717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 980/1965] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:05.201879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.215612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6925c-7fc6-4bce-9499-3e63fea9eeff admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.220669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.221352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.221633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.221962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] PATH_INFO: `/v3/projects/53b995a548a5404787d2dae145565c24/users/77d220edbb324c7d8bc7ff8832e13a22/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.244337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b995a548a5404787d2dae145565c24, user_id=77d220edbb324c7d8bc7ff8832e13a22, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.247558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.279903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 986/1966] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:05 2022] PUT /identity/v3/projects/53b995a548a5404787d2dae145565c24/users/77d220edbb324c7d8bc7ff8832e13a22/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:05.291532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.292071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.292576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.326231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] MFA Rules not processed for user `77d220edbb324c7d8bc7ff8832e13a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:05.328304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:05.384235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:05.407623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 981/1967] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:05.412492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.475351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc8cc7-c2f9-4f94-b1d1-e1230995b42f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.483994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.484623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.484918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.485152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.485831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.487799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.517207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 987/1968] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:05.521115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.532895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71ad6-b3b3-4470-a33c-a3367af47f7c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.593389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.594049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.594327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.594585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.595224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.597176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.623304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 982/1969] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:05 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:05.624614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.635295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a733ce-f292-4a8e-9af6-355a80e634cc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.643395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.644214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.644670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.644942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.645706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.647492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.660952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 988/1970] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:05.665258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.677183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da56c-5f6a-4252-bb80-339c8c0df99d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.684008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.684694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.684969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.685241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] PATH_INFO: `/v3/projects/e2349b2c8cb4459f88c70ebc0d4a6070/users/ccd057e32f1546f9ba9f0c9b445e6dda/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.701654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2349b2c8cb4459f88c70ebc0d4a6070, user_id=ccd057e32f1546f9ba9f0c9b445e6dda, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.704660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.724018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 983/1971] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:05 2022] PUT /identity/v3/projects/e2349b2c8cb4459f88c70ebc0d4a6070/users/ccd057e32f1546f9ba9f0c9b445e6dda/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:05.732395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.743487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84def44-4958-4d65-b5c4-069b0a65322f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.805726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f4916-3e5e-4828-97c1-a1514e17b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.809569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4916-3e5e-4828-97c1-a1514e17b78b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.810111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4916-3e5e-4828-97c1-a1514e17b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.810673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4916-3e5e-4828-97c1-a1514e17b78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.811825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f4916-3e5e-4828-97c1-a1514e17b78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.814945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f4916-3e5e-4828-97c1-a1514e17b78b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.826108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 989/1972] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:55:05.834649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.856377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ef147-afd3-42b2-8f8d-8f701120f7c7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.861889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.862752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.863022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.863285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] PATH_INFO: `/v3/projects/e2349b2c8cb4459f88c70ebc0d4a6070/users/ccd057e32f1546f9ba9f0c9b445e6dda/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.865241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2349b2c8cb4459f88c70ebc0d4a6070, user_id=ccd057e32f1546f9ba9f0c9b445e6dda, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.868475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.880318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 984/1973] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:05 2022] PUT /identity/v3/projects/e2349b2c8cb4459f88c70ebc0d4a6070/users/ccd057e32f1546f9ba9f0c9b445e6dda/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:05.890929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.891216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.891500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.921915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] MFA Rules not processed for user `ccd057e32f1546f9ba9f0c9b445e6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:05.923218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:05.970104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:06.012912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 990/1974] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:06.024718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:06.026573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:06.088970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f09a-4ff4-4e28-9a08-32df54e48f89 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:06.094792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19284e-21e4-466b-b9ba-829c0549d089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:06.095877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19284e-21e4-466b-b9ba-829c0549d089 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.096484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19284e-21e4-466b-b9ba-829c0549d089 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.096887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19284e-21e4-466b-b9ba-829c0549d089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.155116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:06.166282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19284e-21e4-466b-b9ba-829c0549d089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:06.167757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19284e-21e4-466b-b9ba-829c0549d089 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:06.177570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 985/1975] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:08.491405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.493301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.611443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb24fe-1f8c-4d2d-8066-77b670a95625 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.617825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.618487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.618763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.619037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] PATH_INFO: `/v3/users/939c1e2ae88b4eb2a38394d0218a0475` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.620808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] RBAC: Authorizing `identity:delete_user(user_id=939c1e2ae88b4eb2a38394d0218a0475)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.623529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.723216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939c1e2ae88b4eb2a38394d0218a0475'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.724027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939c1e2ae88b4eb2a38394d0218a0475'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.740583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939c1e2ae88b4eb2a38394d0218a0475'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.740583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939c1e2ae88b4eb2a38394d0218a0475'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.763042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939c1e2ae88b4eb2a38394d0218a0475'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.780643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 991/1976] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:08 2022] DELETE /identity/v3/users/939c1e2ae88b4eb2a38394d0218a0475 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:08.785744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.786313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.786442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.809918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:08.811344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.886525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 986/1977] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:08.894899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.896388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.897618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.899785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.958095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7846-3350-4647-92de-fdb37da67d3c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.958353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae97e-b19e-4628-a975-1195ec3e149b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.962599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.962765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.963208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.963469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.963621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.963716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.963895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.964165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.965586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.970682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:08.973673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.975200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.985381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 987/1978] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:09.028109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.029582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.038814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 992/1979] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:09.271763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.274460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.289989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768ce4-823e-47f3-b6b0-1272508efda8 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.300327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.301080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.301687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.302068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] PATH_INFO: `/v3/projects/8d1e7512e0aa419a97d54a5e529854f7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.304437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1e7512e0aa419a97d54a5e529854f7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.310405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.379651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1e7512e0aa419a97d54a5e529854f7', 'request_id': 'req-f77cceaa-08ff-41be-b50b-82cd725c2a1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.388679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1e7512e0aa419a97d54a5e529854f7', 'request_id': 'req-f77cceaa-08ff-41be-b50b-82cd725c2a1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.399895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1e7512e0aa419a97d54a5e529854f7', 'request_id': 'req-f77cceaa-08ff-41be-b50b-82cd725c2a1b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.412587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] The token cache is being invalidate because project 8d1e7512e0aa419a97d54a5e529854f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:09.412883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.413590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.415178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 988/1980] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:09 2022] DELETE /identity/v3/projects/8d1e7512e0aa419a97d54a5e529854f7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:09.419477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.432245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11772-ae3b-48d3-ba1e-5573c01dc167 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.502766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.503485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.503687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.503942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] PATH_INFO: `/v3/users/a4e07a7cedf2454982a49145d2ba6eba` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.505064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e07a7cedf2454982a49145d2ba6eba)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.507134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.557547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e07a7cedf2454982a49145d2ba6eba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.558592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e07a7cedf2454982a49145d2ba6eba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.568416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e07a7cedf2454982a49145d2ba6eba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.569045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e07a7cedf2454982a49145d2ba6eba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.585932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e07a7cedf2454982a49145d2ba6eba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.599977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 993/1981] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:09 2022] DELETE /identity/v3/users/a4e07a7cedf2454982a49145d2ba6eba => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:09.684858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.687268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.735119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:09.798832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cceaa-08ff-41be-b50b-82cd725c2a1b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.899302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.900281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.900565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.900837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.902739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.996002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.997757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.010177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 989/1982] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:10.011424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.013132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.055392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:10.129520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92bea-4e57-48c1-b41b-254708573a2f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.134618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.135387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.135679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.136001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] PATH_INFO: `/v3/projects/167b2b5f619842aa8ed78491f0686109` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.137381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167b2b5f619842aa8ed78491f0686109)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.139814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.194214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167b2b5f619842aa8ed78491f0686109', 'request_id': 'req-252bd9d0-7a33-4cb9-9f8a-47608ece8168'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.200909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167b2b5f619842aa8ed78491f0686109', 'request_id': 'req-252bd9d0-7a33-4cb9-9f8a-47608ece8168'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.216171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167b2b5f619842aa8ed78491f0686109', 'request_id': 'req-252bd9d0-7a33-4cb9-9f8a-47608ece8168'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.228973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] The token cache is being invalidate because project 167b2b5f619842aa8ed78491f0686109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:10.229281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.229947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.231452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 994/1983] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:10 2022] DELETE /identity/v3/projects/167b2b5f619842aa8ed78491f0686109 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:10.235491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.246390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13e59-9b5c-4136-b2b6-e31136eb5167 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.304390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.305103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.305381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.305636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] PATH_INFO: `/v3/users/9b8beddc04d7448ca5dff16a3cfbd461` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.307394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8beddc04d7448ca5dff16a3cfbd461)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.309334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.340948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:10.363462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8beddc04d7448ca5dff16a3cfbd461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.371405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8beddc04d7448ca5dff16a3cfbd461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.372048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8beddc04d7448ca5dff16a3cfbd461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.385202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8beddc04d7448ca5dff16a3cfbd461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.386021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69d27078-b422-4070-8537-5f40217e3694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8beddc04d7448ca5dff16a3cfbd461'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.399088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 990/1984] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:10 2022] DELETE /identity/v3/users/9b8beddc04d7448ca5dff16a3cfbd461 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:10.720694 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.722208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.739265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd9d0-7a33-4cb9-9f8a-47608ece8168 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.797952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.798623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.798900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.799179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] PATH_INFO: `/v3/projects/670f1f9c93eb4d99924aa7cf0e8fde2f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.800456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670f1f9c93eb4d99924aa7cf0e8fde2f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.802520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.851572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670f1f9c93eb4d99924aa7cf0e8fde2f', 'request_id': 'req-dc374ec9-2252-4a8e-b3f8-95408f319e40'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.857974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670f1f9c93eb4d99924aa7cf0e8fde2f', 'request_id': 'req-dc374ec9-2252-4a8e-b3f8-95408f319e40'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.860563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:10.868097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670f1f9c93eb4d99924aa7cf0e8fde2f', 'request_id': 'req-dc374ec9-2252-4a8e-b3f8-95408f319e40'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.879430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] The token cache is being invalidate because project 670f1f9c93eb4d99924aa7cf0e8fde2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:10.879715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.880347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dc374ec9-2252-4a8e-b3f8-95408f319e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.881893 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 995/1985] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:10 2022] DELETE /identity/v3/projects/670f1f9c93eb4d99924aa7cf0e8fde2f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:10.889223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.889705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.889913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.910705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:10.911851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.974370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 991/1986] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:10.984636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.984918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.985194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.005906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:11.007084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:11.015386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 996/1987] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:11.019953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.030066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c6c1a-2d77-47ad-97c9-48af05a32211 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.035337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.035927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.036204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.036473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.037121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:11.037414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.039132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.051366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 992/1988] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:11.056086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.065801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e108-35d2-46d7-862d-10b2d12c43ec None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.071279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.071878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.072144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.072424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.073043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.075000 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.107164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 997/1989] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:11 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:11.111278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.122329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae0be-779a-42e0-8513-e020582f87c6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.190039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.190781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.191163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.191436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.192099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.194077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.220712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 993/1990] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:11 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:11.225031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.240450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b807a3-11a7-491d-98eb-9cf37ff4a483 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.250982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.251885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.252325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.252774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.253441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.261103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.276639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 998/1991] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:11.278205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.291839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7db0e-4e37-4606-a0a6-e3968c574f9e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.297345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f222234-7581-463b-b687-46f6f4245665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.298111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f222234-7581-463b-b687-46f6f4245665 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.298737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f222234-7581-463b-b687-46f6f4245665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.299211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f222234-7581-463b-b687-46f6f4245665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.300133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f222234-7581-463b-b687-46f6f4245665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.302816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f222234-7581-463b-b687-46f6f4245665 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.317181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 994/1992] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:11.322232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.333547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479667ce-326e-4c77-93ad-b374f3d5055f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.339652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.341217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.341588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.342044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] PATH_INFO: `/v3/projects/ac78b8a933f24947a54c865eac430c04/users/540b179683764d8a87b9ea629dfbadb6/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.367376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac78b8a933f24947a54c865eac430c04, user_id=540b179683764d8a87b9ea629dfbadb6, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.371957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.391848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 999/1993] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:11 2022] PUT /identity/v3/projects/ac78b8a933f24947a54c865eac430c04/users/540b179683764d8a87b9ea629dfbadb6/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:11.405922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.406520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.407036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.434969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:11.463557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] MFA Rules not processed for user `540b179683764d8a87b9ea629dfbadb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:11.470288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:11.559308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 995/1994] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:11.583677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.585542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:11.649444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c9114-cd01-4cfd-9bde-d5e3f387ee7a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.653390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.656380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.656380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.656380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.669929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.671488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.684882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1000/1995] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:13.338530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:13.340319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:13.391737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:13.393197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:13.426416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48d73b-8138-4ea0-9120-3811c0eaf39d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:13.432941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:13.433943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:13.434330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:13.434666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] PATH_INFO: `/v3/users/2809c4fad14c42a1b9fb9f0734ce2d3a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:13.435915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2809c4fad14c42a1b9fb9f0734ce2d3a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:13.437975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:13.470153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8343-5a94-4e32-8d1a-17e03d84be4b service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:13.475971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:13.476782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:13.477133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:13.477518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] PATH_INFO: `/v3/users/f64133d737ba44f38e06ab823970f903` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:13.479102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64133d737ba44f38e06ab823970f903)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:13.482066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:13.499263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2809c4fad14c42a1b9fb9f0734ce2d3a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.521763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2809c4fad14c42a1b9fb9f0734ce2d3a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.522788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2809c4fad14c42a1b9fb9f0734ce2d3a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.527192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:13.542666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2809c4fad14c42a1b9fb9f0734ce2d3a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.543844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9a1dcacc-bf8c-440d-9f31-b76ce981f98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2809c4fad14c42a1b9fb9f0734ce2d3a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.549352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64133d737ba44f38e06ab823970f903'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.550079 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64133d737ba44f38e06ab823970f903'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.558483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 996/1996] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:13 2022] DELETE /identity/v3/users/2809c4fad14c42a1b9fb9f0734ce2d3a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:13.559735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64133d737ba44f38e06ab823970f903'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.560402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64133d737ba44f38e06ab823970f903'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.562792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:13.563081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:13.563504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:13.574718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a049f6e2-a0be-44a4-9e32-77405a9fab80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64133d737ba44f38e06ab823970f903'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:13.582872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:13.584102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:13.588037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1001/1997] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:13 2022] DELETE /identity/v3/users/f64133d737ba44f38e06ab823970f903 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:13.593022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:13.593022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:13.593295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:13.598462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:13.613335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:13.614636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:13.650008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 997/1998] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:13.660014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:13.661368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:13.676414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1002/1999] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:13.686606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:13.687976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:13.719091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2458e95-8998-4757-9794-32d3ef1e83bc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:13.745493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b375a-f166-457a-91c4-5666124408d2 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:13.749354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:13.750012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:13.750291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:13.750560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:13.759888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:13.761420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:13.768741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:13.769408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:13.769688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:13.769994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:13.771358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1003/2000] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:13.782916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:13.784286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:13.793907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 998/2001] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:14.040761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.043408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.063734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6885b7-2b92-4174-9973-e76db4768950 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.068628 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.069278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.069557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.069905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] PATH_INFO: `/v3/users/85572d315fef4ff8828b12d72e292772` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.071044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85572d315fef4ff8828b12d72e292772)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.073015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.138044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:14.147412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85572d315fef4ff8828b12d72e292772'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.148084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85572d315fef4ff8828b12d72e292772'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.159541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85572d315fef4ff8828b12d72e292772'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.160577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85572d315fef4ff8828b12d72e292772'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.176074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0d0b5f19-100d-4a92-bc29-5ab5c181f175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85572d315fef4ff8828b12d72e292772'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.181066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.183003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.198675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da702-d407-4ea0-9308-6fee3def8128 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.205595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.206588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.207010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.207289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] PATH_INFO: `/v3/projects/38e2c2e8ea054b54b64c4bad76df2c8a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.209250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e2c2e8ea054b54b64c4bad76df2c8a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.210977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.211221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1004/2002] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:14 2022] DELETE /identity/v3/users/85572d315fef4ff8828b12d72e292772 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:14.215433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.215786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.216091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.245871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:14.247515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.294798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e2c2e8ea054b54b64c4bad76df2c8a', 'request_id': 'req-10611128-52ba-4157-bcc8-a33799de2520'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.300880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e2c2e8ea054b54b64c4bad76df2c8a', 'request_id': 'req-10611128-52ba-4157-bcc8-a33799de2520'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.311875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e2c2e8ea054b54b64c4bad76df2c8a', 'request_id': 'req-10611128-52ba-4157-bcc8-a33799de2520'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.324147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:14.329362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1005/2003] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:14.330416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.332945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] The token cache is being invalidate because project 38e2c2e8ea054b54b64c4bad76df2c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:14.333299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.334045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.336080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 999/2004] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:14 2022] DELETE /identity/v3/projects/38e2c2e8ea054b54b64c4bad76df2c8a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:14.338454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.338956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.340594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.357794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1db8-401e-4e3d-a6e5-e76a70652cd1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.429619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10611128-52ba-4157-bcc8-a33799de2520 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.443217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.443873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.444149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.444420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.446869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.449011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.449714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.450022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.450294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] PATH_INFO: `/v3/projects/e6e7dcd5527b4bfc9d682cdeb017d382` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.451526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e7dcd5527b4bfc9d682cdeb017d382)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.453461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.461429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.463502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.474033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1000/2005] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:14.474832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.476258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.488728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afbe8-f0e9-4b60-a27a-1064ff803dcd service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.495037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.496395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.496674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.496946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] PATH_INFO: `/v3/users/cb6376d2ab9f489584c1bd425a030487` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.498838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6376d2ab9f489584c1bd425a030487)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.501682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.503954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e7dcd5527b4bfc9d682cdeb017d382', 'request_id': 'req-55dcbd86-d9b6-4196-acee-077ec2e68a80'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.510845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e7dcd5527b4bfc9d682cdeb017d382', 'request_id': 'req-55dcbd86-d9b6-4196-acee-077ec2e68a80'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.520567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e7dcd5527b4bfc9d682cdeb017d382', 'request_id': 'req-55dcbd86-d9b6-4196-acee-077ec2e68a80'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.522241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:14.543021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] The token cache is being invalidate because project e6e7dcd5527b4bfc9d682cdeb017d382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:14.543426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.544393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-55dcbd86-d9b6-4196-acee-077ec2e68a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.546438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1006/2006] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:14 2022] DELETE /identity/v3/projects/e6e7dcd5527b4bfc9d682cdeb017d382 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:14.551787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.552050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.552348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.573147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6376d2ab9f489584c1bd425a030487'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.579181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:14.580838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.582051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6376d2ab9f489584c1bd425a030487'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.582755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6376d2ab9f489584c1bd425a030487'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.597175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6376d2ab9f489584c1bd425a030487'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.597913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-21b49b0b-523d-4347-accc-f1941c1f8e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6376d2ab9f489584c1bd425a030487'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:14.613860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1001/2007] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:14 2022] DELETE /identity/v3/users/cb6376d2ab9f489584c1bd425a030487 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:14.656136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1007/2008] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:14.664112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.664397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.664668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.686405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:14.687724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.755385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1002/2009] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:14.759969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.770434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad328f-8aeb-426a-82eb-1ceb3e35d9ce None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.776018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.776800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.777167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.777503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.778194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:14.778498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.780154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.793885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1008/2010] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:14.799908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.812002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2993c7-a6da-4ca7-a088-9bda419ac740 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.820001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.820749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.821122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.821477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.822247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.824149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.840394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:14.860513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1003/2011] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:14 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:14.865008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.881546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ee3e-307c-423c-bddf-9b34a0609091 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:14.898751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.900869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:14.952065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:14.952704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:14.953134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:14.953414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:14.954084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:14.956116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:14.981561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1009/2012] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:14 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:14.985887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:14.998221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51b53-3fcb-4887-b00a-b3fd21479e84 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.004199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.005064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.005572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.006116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.006850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.007170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ac019-0caa-4e1c-9573-e6667bbe5ebe admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.009398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.012814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.013603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.013929 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.014242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] PATH_INFO: `/v3/projects/d457155f4c9040dbad6ecdd17e9d47c7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.015582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d457155f4c9040dbad6ecdd17e9d47c7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.017513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.029403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1010/2013] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:15.029403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.031545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.046034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5f131-0d27-4a23-a266-5585f854fa7e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.052538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.053593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.054043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.054435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] PATH_INFO: `/v3/projects/774f7d9692b04ce4a75d8087ea68ed4b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.055712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=774f7d9692b04ce4a75d8087ea68ed4b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.058373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.077641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd457155f4c9040dbad6ecdd17e9d47c7', 'request_id': 'req-3a48d527-f8e0-4306-aeca-6151ed73a90a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.086419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd457155f4c9040dbad6ecdd17e9d47c7', 'request_id': 'req-3a48d527-f8e0-4306-aeca-6151ed73a90a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.095044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd457155f4c9040dbad6ecdd17e9d47c7', 'request_id': 'req-3a48d527-f8e0-4306-aeca-6151ed73a90a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.108553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] The token cache is being invalidate because project d457155f4c9040dbad6ecdd17e9d47c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:15.108696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774f7d9692b04ce4a75d8087ea68ed4b', 'request_id': 'req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.109014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.109604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.111283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:15.111826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1004/2014] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:14 2022] DELETE /identity/v3/projects/d457155f4c9040dbad6ecdd17e9d47c7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:15.112810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.114298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.116223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774f7d9692b04ce4a75d8087ea68ed4b', 'request_id': 'req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.127381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774f7d9692b04ce4a75d8087ea68ed4b', 'request_id': 'req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.141133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] The token cache is being invalidate because project 774f7d9692b04ce4a75d8087ea68ed4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:15.141421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.142470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.144067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1011/2015] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:15 2022] DELETE /identity/v3/projects/774f7d9692b04ce4a75d8087ea68ed4b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:15.144874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.146578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.186838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48d527-f8e0-4306-aeca-6151ed73a90a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.213475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494f15-85ec-4a3a-9aa4-d50fc28e1e1f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.216485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:15.218404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.219155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.219432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.219702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] PATH_INFO: `/v3/users/77d220edbb324c7d8bc7ff8832e13a22` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.220870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d220edbb324c7d8bc7ff8832e13a22)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.223263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.248077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b0c58-61c8-4bb9-9792-544d74db1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.248708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b0c58-61c8-4bb9-9792-544d74db1214 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.248982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b0c58-61c8-4bb9-9792-544d74db1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.249278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b0c58-61c8-4bb9-9792-544d74db1214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.249974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b0c58-61c8-4bb9-9792-544d74db1214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.251979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b0c58-61c8-4bb9-9792-544d74db1214 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.263574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1005/2016] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:15.264876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.265170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.265441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.275488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d220edbb324c7d8bc7ff8832e13a22'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.276190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d220edbb324c7d8bc7ff8832e13a22'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.285570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d220edbb324c7d8bc7ff8832e13a22'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.285726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:15.286222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d220edbb324c7d8bc7ff8832e13a22'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.287084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.296029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1006/2017] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:15.296751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.298068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.298841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e1600b47-cebf-47bc-ba74-caf32d9fcf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d220edbb324c7d8bc7ff8832e13a22'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.310927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28456090-6c76-4591-a815-2c1f3cdfc3b2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.313418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1012/2018] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:15 2022] DELETE /identity/v3/users/77d220edbb324c7d8bc7ff8832e13a22 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:15.314715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.314997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.315293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.320097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3471-f908-4f77-ae09-3bacf4094244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.320806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3471-f908-4f77-ae09-3bacf4094244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.321080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3471-f908-4f77-ae09-3bacf4094244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.321372 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3471-f908-4f77-ae09-3bacf4094244 admin admin] PATH_INFO: `/v3/projects/c7fb12ca0da546dcbcff810209d6fc40/users/fc33c6252cf04fd984cdcfe3913e3dcc/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.337442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:15.337597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb3471-f908-4f77-ae09-3bacf4094244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fb12ca0da546dcbcff810209d6fc40, user_id=fc33c6252cf04fd984cdcfe3913e3dcc, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.338713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.340828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb3471-f908-4f77-ae09-3bacf4094244 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.356075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1007/2019] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:15 2022] PUT /identity/v3/projects/c7fb12ca0da546dcbcff810209d6fc40/users/fc33c6252cf04fd984cdcfe3913e3dcc/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:15.362154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.362862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.363310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.385114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:15.386509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.402816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:15.418132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1013/2020] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:15.422278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.433320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cc6f8-d7b0-460b-a88b-e0a77497a96c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.463012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1008/2021] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:15.471401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.473554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.501157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.501647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.501947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.502299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.502870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:15.503242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.504795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.518217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1014/2022] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:55:15.522114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.532637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb3bcc-30fe-4981-91db-befeddcf66f7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.540771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.541400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.541751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.541959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.542610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.544541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.573892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8de356-5449-4ac4-8dbe-5dd006261484 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.577866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.578638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.578777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.579165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.591062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1015/2023] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:15.591291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.591406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.593020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.605805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1009/2024] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:15.661357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63200e6-86af-4d88-8a73-03e88975a1d1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.666309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.666898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.667171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.667437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.668064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.670025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.693113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1016/2025] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:15.697436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.707007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a72057-aa90-4b7d-b5de-055ed78cdebc service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.711777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.712383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.712657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.712916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.713556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.715198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.729070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1010/2026] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:15.730466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.742649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65b4b-003b-485f-8635-3392a1c25afd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.750772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.751481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.751821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.752217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.753080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.756006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.766429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1017/2027] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:15.770842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.781339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82602-0d47-4281-87fb-b082bb9c2759 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.788324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.788509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec9601-35ba-4faf-87dd-d05f3630cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.789306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9601-35ba-4faf-87dd-d05f3630cf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.789849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9601-35ba-4faf-87dd-d05f3630cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.790187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9601-35ba-4faf-87dd-d05f3630cf07 admin admin] PATH_INFO: `/v3/projects/0b59a14644e440c88ca4e3483169e8d3/users/14b0d2d199e74103bd35b98088b837c4/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.790449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.808098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f524f4-0c7e-40ca-9ea4-e81dfac16ee0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:15.810300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec9601-35ba-4faf-87dd-d05f3630cf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b59a14644e440c88ca4e3483169e8d3, user_id=14b0d2d199e74103bd35b98088b837c4, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.813017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec9601-35ba-4faf-87dd-d05f3630cf07 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.821347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:15.823136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.824716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.825194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] PATH_INFO: `/v3/projects/53b995a548a5404787d2dae145565c24` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.826959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b995a548a5404787d2dae145565c24)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:15.831217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:15.835318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1011/2028] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:15 2022] PUT /identity/v3/projects/0b59a14644e440c88ca4e3483169e8d3/users/14b0d2d199e74103bd35b98088b837c4/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:15.846393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:15.846688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:15.846949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:15.856721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:15.881597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] MFA Rules not processed for user `14b0d2d199e74103bd35b98088b837c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:15.883320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.890641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:15.895116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b995a548a5404787d2dae145565c24', 'request_id': 'req-e680dc66-9310-4529-8109-2efeaa76c504'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.906537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b995a548a5404787d2dae145565c24', 'request_id': 'req-e680dc66-9310-4529-8109-2efeaa76c504'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.918483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b995a548a5404787d2dae145565c24', 'request_id': 'req-e680dc66-9310-4529-8109-2efeaa76c504'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.931619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] The token cache is being invalidate because project 53b995a548a5404787d2dae145565c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:15.932344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.933093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:15.935018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1018/2029] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:15 2022] DELETE /identity/v3/projects/53b995a548a5404787d2dae145565c24 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:15.938788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.940650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:15.977446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1012/2030] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:15.982188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:15.983685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.016509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680dc66-9310-4529-8109-2efeaa76c504 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.021908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.022556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.022958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.023239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] PATH_INFO: `/v3/users/ccd057e32f1546f9ba9f0c9b445e6dda` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.024402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd057e32f1546f9ba9f0c9b445e6dda)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.026603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.070540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c02421-559d-4008-bd0e-20f2ba1285c8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.075725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.076362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.076738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.076984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.077638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.079841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.087372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd057e32f1546f9ba9f0c9b445e6dda'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.088071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd057e32f1546f9ba9f0c9b445e6dda'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.100152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd057e32f1546f9ba9f0c9b445e6dda'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.101395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd057e32f1546f9ba9f0c9b445e6dda'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.121167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1013/2031] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:15 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:16.123826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.127014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.127712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd057e32f1546f9ba9f0c9b445e6dda'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.157358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1019/2032] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:15 2022] DELETE /identity/v3/users/ccd057e32f1546f9ba9f0c9b445e6dda => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:16.215846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77f933-d8fa-49e5-b304-9c40b07ec90e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.242463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:16.277899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.278541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.278815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.279077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.279738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.281688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.310196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1014/2033] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:16 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:16.312124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.323222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c768-bf0d-4b68-b20d-1d7bbb7e5e74 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.329639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.330229 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.330505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.330773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.331418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.333059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.343561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1020/2034] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:16.348097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.358244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed10fe-1712-40bc-b3c2-f29c81f983e9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.363969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.364630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.365271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.365271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] PATH_INFO: `/v3/projects/a9e33a1b341f413a99e2bdf9cac529cc/users/3cc2baea9af3400496e25b0bda99075f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.382550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e33a1b341f413a99e2bdf9cac529cc, user_id=3cc2baea9af3400496e25b0bda99075f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.385213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.398964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1015/2035] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:16 2022] PUT /identity/v3/projects/a9e33a1b341f413a99e2bdf9cac529cc/users/3cc2baea9af3400496e25b0bda99075f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:16.403096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.414846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844017-dbab-4227-8ac7-ff300d2d2e83 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.454399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:16.480256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cf662-02a0-4816-a333-8b80d7a3f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.480902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf662-02a0-4816-a333-8b80d7a3f607 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.481186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf662-02a0-4816-a333-8b80d7a3f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.481492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf662-02a0-4816-a333-8b80d7a3f607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.482226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cf662-02a0-4816-a333-8b80d7a3f607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.483800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cf662-02a0-4816-a333-8b80d7a3f607 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.497821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1021/2036] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:16.501963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.514341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d4f2-2d09-452e-ab3b-27d23ee8f583 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.519608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b588-3c65-459e-a654-2bc473b74277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.520554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b588-3c65-459e-a654-2bc473b74277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.521516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b588-3c65-459e-a654-2bc473b74277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.522314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b588-3c65-459e-a654-2bc473b74277 admin admin] PATH_INFO: `/v3/projects/a9e33a1b341f413a99e2bdf9cac529cc/users/3cc2baea9af3400496e25b0bda99075f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.524647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b588-3c65-459e-a654-2bc473b74277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e33a1b341f413a99e2bdf9cac529cc, user_id=3cc2baea9af3400496e25b0bda99075f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.527730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b588-3c65-459e-a654-2bc473b74277 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.541171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1016/2037] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:16 2022] PUT /identity/v3/projects/a9e33a1b341f413a99e2bdf9cac529cc/users/3cc2baea9af3400496e25b0bda99075f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:16.552080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.552579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.552669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.582953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.583231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.583498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.587207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] MFA Rules not processed for user `3cc2baea9af3400496e25b0bda99075f`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:16.588850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.639694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] MFA Rules not processed for user `fc33c6252cf04fd984cdcfe3913e3dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:16.640124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.689201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1022/2038] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:16.689201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.689201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.742643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1017/2039] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:16.743799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.745064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.776879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02793b34-6e06-4a82-8f0f-137a541ceb8f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.783014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.783670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.783943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.784213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] PATH_INFO: `/v3/projects/e2349b2c8cb4459f88c70ebc0d4a6070` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.785360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2349b2c8cb4459f88c70ebc0d4a6070)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.787417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.821615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0c65b-f802-48eb-8ab0-e7affe18e4e5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.826412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.827048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.827320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.827725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.841083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.846950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.849248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2349b2c8cb4459f88c70ebc0d4a6070', 'request_id': 'req-40357c3c-22e5-4705-a324-5cc1a08a3fa8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.856204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2349b2c8cb4459f88c70ebc0d4a6070', 'request_id': 'req-40357c3c-22e5-4705-a324-5cc1a08a3fa8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.861636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1018/2040] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:16.863043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.864705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.871247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2349b2c8cb4459f88c70ebc0d4a6070', 'request_id': 'req-40357c3c-22e5-4705-a324-5cc1a08a3fa8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.875702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:16.879115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8284-f045-4127-87c0-49bb58c08c10 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.889564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] The token cache is being invalidate because project e2349b2c8cb4459f88c70ebc0d4a6070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:16.890074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.892248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:16.892431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-40357c3c-22e5-4705-a324-5cc1a08a3fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.895084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1023/2041] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:16 2022] DELETE /identity/v3/projects/e2349b2c8cb4459f88c70ebc0d4a6070 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:16.907881 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.908288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.909250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.940990 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:16.943815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.979373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.980337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.980775 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.981053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.985666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.020837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1024/2042] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:17.022841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.025298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.037207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37f32-5d47-45b8-80a0-c84908aa2564 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.040780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.041450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.041666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.041963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.043703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.048657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.050175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9228f-229b-4840-a2fd-123ce1b149fa service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.059740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1019/2043] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:17.060979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.061222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.061490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.083322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:17.084739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.093361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1020/2044] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:17.097545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.106922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b190161-a8be-4a26-ac76-c3fc601a98b5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.108141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.109742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.111697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.112306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.112659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.112892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.113815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:17.113925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.115450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.120853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1025/2045] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:17.128408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1021/2046] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:55:17.132915 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.145456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af5c9-bf8d-4e1a-a1e1-b922d6c33e8d service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.150156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.150843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.151474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.151474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.152196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.154185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.186460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1026/2047] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:17 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:17.190954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.201262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081275a8-11ce-4381-a10a-28feda939d30 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.282229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.282978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.283357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.283697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.284717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.286735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.313200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1022/2048] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:17 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:17.314383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.325787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8914f1-3761-43b7-a493-948aaac39019 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.332069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.332931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.333633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.334644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.335756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.337780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.354428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1027/2049] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:55:17.359180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.390681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098cfa-5b4f-4073-82b7-7ac8d050c36a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.397306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecca60-74a2-4797-b0ce-3d805cee6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.397987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecca60-74a2-4797-b0ce-3d805cee6053 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.398266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecca60-74a2-4797-b0ce-3d805cee6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.398587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecca60-74a2-4797-b0ce-3d805cee6053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.400226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecca60-74a2-4797-b0ce-3d805cee6053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.402231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecca60-74a2-4797-b0ce-3d805cee6053 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.423094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1023/2050] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:17.423854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.436661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d505b6-fde3-47b3-934f-88dfcde9bd0e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.446730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.448125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.449221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.449900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] PATH_INFO: `/v3/projects/24a5eccad43a4e3d9d7d6824ed44b9d7/users/916341bb0a2145ccad3a58b9246810b5/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.485039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a5eccad43a4e3d9d7d6824ed44b9d7, user_id=916341bb0a2145ccad3a58b9246810b5, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.487870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.502332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1028/2051] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:17 2022] PUT /identity/v3/projects/24a5eccad43a4e3d9d7d6824ed44b9d7/users/916341bb0a2145ccad3a58b9246810b5/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:17.514573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b4013-54e7-4412-9302-ea4e288275fd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.514851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b4013-54e7-4412-9302-ea4e288275fd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.515292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b4013-54e7-4412-9302-ea4e288275fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.544241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a12b4013-54e7-4412-9302-ea4e288275fd None None] MFA Rules not processed for user `916341bb0a2145ccad3a58b9246810b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:17.545446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a12b4013-54e7-4412-9302-ea4e288275fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.558560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:17.613011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1024/2052] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:17.625146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.627196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.667884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:17.713273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ef46-5a91-4e3e-8b19-210e59950eb8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.717453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.718110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.718396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.718719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.728468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.730174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.740553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1029/2053] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:18.556517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f81b-f386-42ca-b9a8-98f6e470ad84 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:18.557554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f81b-f386-42ca-b9a8-98f6e470ad84 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:18.558259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f81b-f386-42ca-b9a8-98f6e470ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:18.581008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4fe9f81b-f386-42ca-b9a8-98f6e470ad84 None None] MFA Rules not processed for user `fc33c6252cf04fd984cdcfe3913e3dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:18.582558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4fe9f81b-f386-42ca-b9a8-98f6e470ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:18.654955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1025/2054] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:20.593833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:20.595281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:20.682292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a409-fad3-4a63-bff0-ee6c392375e1 service glance] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:20.688115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:20.689158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:20.689398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:20.689794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] PATH_INFO: `/v3/users/540b179683764d8a87b9ea629dfbadb6` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:20.694230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540b179683764d8a87b9ea629dfbadb6)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:20.696642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:20.752700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540b179683764d8a87b9ea629dfbadb6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:20.753529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540b179683764d8a87b9ea629dfbadb6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:20.764097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540b179683764d8a87b9ea629dfbadb6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:20.764734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540b179683764d8a87b9ea629dfbadb6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:20.784003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540b179683764d8a87b9ea629dfbadb6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:20.801654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1030/2055] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:20 2022] DELETE /identity/v3/users/540b179683764d8a87b9ea629dfbadb6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:20.803433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:20.804008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:20.804008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:20.823379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:20.824531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:20.894461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1026/2056] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:20.904657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:20.906189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:20.953609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:20.987692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0921e-7b94-44fb-a5a3-8b8a6dae8425 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:20.991585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c1644-8829-4fa8-909e-66799d3def7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:20.992236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c1644-8829-4fa8-909e-66799d3def7a service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:20.992520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c1644-8829-4fa8-909e-66799d3def7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:20.992791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c1644-8829-4fa8-909e-66799d3def7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.002533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c1644-8829-4fa8-909e-66799d3def7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.004205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c1644-8829-4fa8-909e-66799d3def7a service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.016266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1031/2057] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:21.303894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.305651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.321441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2ede-a44e-4e79-85eb-2dd0aacc856a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.327976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.328659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.328938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.329208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] PATH_INFO: `/v3/projects/ac78b8a933f24947a54c865eac430c04` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.330399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac78b8a933f24947a54c865eac430c04)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.332362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.383731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac78b8a933f24947a54c865eac430c04', 'request_id': 'req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:21.390688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac78b8a933f24947a54c865eac430c04', 'request_id': 'req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:21.392390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:21.402271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac78b8a933f24947a54c865eac430c04', 'request_id': 'req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:21.415606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] The token cache is being invalidate because project ac78b8a933f24947a54c865eac430c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:21.415890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:21.416615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b1eac79-de4f-40ff-9f87-c8aeb84e9c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:21.418296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1027/2058] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:21 2022] DELETE /identity/v3/projects/ac78b8a933f24947a54c865eac430c04 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:21.423498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.423786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.424063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.448263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:21.449645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.510991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1032/2059] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:21.519170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.519466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.519696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.545276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:21.546512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.554897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1028/2060] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:21.560247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.573839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00e39-fc88-41e2-8937-579a5a794fc9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.581887 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.582708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.583082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.583431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.584443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:21.584849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.586858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.599599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1033/2061] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:21.604393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.614483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662077b0-6228-41fe-a841-fd0d3aa229cc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.620663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.621394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.621671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.621971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.622622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.624625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.659451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1029/2062] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:21.664704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.679124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3144c6-05d5-473e-bd1a-61e03dff7d5c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.751427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.752047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.752328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.752610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.753241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.755222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.777888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1034/2063] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/users => generated 280 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:21.782201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.793959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979de5-a34b-4df2-b393-509438d7c236 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.800919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.801829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.802161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.802435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.803552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.804837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.817727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1030/2064] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:21.826070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.864256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24842ad-9b50-46e9-abbd-e7032624e14e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.870517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27da5b-e1f2-4b4c-bea7-67ba45990d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.871234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27da5b-e1f2-4b4c-bea7-67ba45990d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.872026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27da5b-e1f2-4b4c-bea7-67ba45990d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.872026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27da5b-e1f2-4b4c-bea7-67ba45990d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.872622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27da5b-e1f2-4b4c-bea7-67ba45990d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.874401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27da5b-e1f2-4b4c-bea7-67ba45990d29 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.894722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1035/2065] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:55:21.902971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.917296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0fde-c5ff-4e88-a397-a478f05aa8b1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.923608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.924297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.924576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.924848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] PATH_INFO: `/v3/projects/4f08703e7dcc47c4a47c1309cdf18bd5/users/e9f9dfe0b1de4549aebc1830728b881a/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.941883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f08703e7dcc47c4a47c1309cdf18bd5, user_id=e9f9dfe0b1de4549aebc1830728b881a, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.944757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.959122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1031/2066] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:21 2022] PUT /identity/v3/projects/4f08703e7dcc47c4a47c1309cdf18bd5/users/e9f9dfe0b1de4549aebc1830728b881a/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:21.970302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.970585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.970859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.008823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] MFA Rules not processed for user `e9f9dfe0b1de4549aebc1830728b881a`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:22.010095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.050008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:22.092039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1036/2067] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:22.131030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:22.132897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.196673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:22.198308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.202208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eab88b-0d7b-46be-b958-f543aa982371 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:22.207000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:22.207676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.208030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.208359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.217460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:22.219006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:22.228912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1032/2068] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:22.246120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:22.290704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b8c3-6467-4e61-b5a5-79a5c45f5892 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:22.296123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:22.297050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.297188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.297410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] PATH_INFO: `/v3/users/14b0d2d199e74103bd35b98088b837c4` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.298695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b0d2d199e74103bd35b98088b837c4)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:22.300843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:22.318707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f0ac-13a9-4596-bda4-9f85aa9905da service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:22.323618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:22.324318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.325130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.325401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] PATH_INFO: `/v3/users/e9f9dfe0b1de4549aebc1830728b881a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.326586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f9dfe0b1de4549aebc1830728b881a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:22.328688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:22.376826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b0d2d199e74103bd35b98088b837c4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.378015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b0d2d199e74103bd35b98088b837c4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.379933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=3,keystone:DELETE=7,keystone:SELECT=90 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:22.391240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b0d2d199e74103bd35b98088b837c4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.392108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b0d2d199e74103bd35b98088b837c4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.409688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-64a2f16c-59f7-4f2e-bdc2-2fbb931e80b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b0d2d199e74103bd35b98088b837c4'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.413498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f9dfe0b1de4549aebc1830728b881a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.424718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1037/2069] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:22 2022] DELETE /identity/v3/users/14b0d2d199e74103bd35b98088b837c4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:22.427446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f9dfe0b1de4549aebc1830728b881a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.430137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.430414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.430682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.431096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f9dfe0b1de4549aebc1830728b881a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.445663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f9dfe0b1de4549aebc1830728b881a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.446435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-706827d3-76ca-4583-99ed-26ff1e2c0101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f9dfe0b1de4549aebc1830728b881a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:22.458302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:22.459515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.469330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1033/2070] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:22 2022] DELETE /identity/v3/users/e9f9dfe0b1de4549aebc1830728b881a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:22.471639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.474325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.474834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.500969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:22.502755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.531474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:22.559621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1038/2071] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:22.569414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:22.571040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.581026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1034/2072] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:22.587868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:22.590069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:22.633724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ab76e-40d9-45de-8d10-00160fff8cd7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:22.662303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81642-d6d6-49cc-a852-b7e79e1749ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:22.666739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:22.667341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.667604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.667869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.682085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:22.684162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:22.685802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928b48-b897-46e8-a0a7-4e58d466a004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:22.686439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928b48-b897-46e8-a0a7-4e58d466a004 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:22.686723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928b48-b897-46e8-a0a7-4e58d466a004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:22.686996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928b48-b897-46e8-a0a7-4e58d466a004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:22.696516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81928b48-b897-46e8-a0a7-4e58d466a004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:22.696858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1035/2073] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:22.699396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81928b48-b897-46e8-a0a7-4e58d466a004 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:22.710473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1039/2074] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:23.235900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.237370 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:23.255190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014f513-2ef0-4fce-83d0-d2082b961d4f service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.283611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.284265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.284538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.284806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] PATH_INFO: `/v3/projects/4f08703e7dcc47c4a47c1309cdf18bd5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.287982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f08703e7dcc47c4a47c1309cdf18bd5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.293242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.344640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:23.353511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f08703e7dcc47c4a47c1309cdf18bd5', 'request_id': 'req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.361174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f08703e7dcc47c4a47c1309cdf18bd5', 'request_id': 'req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.370703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f08703e7dcc47c4a47c1309cdf18bd5', 'request_id': 'req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.383849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] The token cache is being invalidate because project 4f08703e7dcc47c4a47c1309cdf18bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:23.384254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.385046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8dee8cf2-8d77-43d1-9636-7f4ed6df7f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.386757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1036/2075] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:23 2022] DELETE /identity/v3/projects/4f08703e7dcc47c4a47c1309cdf18bd5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:23.392932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.393308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.393644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.414824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:23.416109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:23.499226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1040/2076] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:23.507100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.507442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.507721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.528124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:23.529388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:23.542688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.544082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1037/2077] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:23.544224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:23.548465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.557137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164a7a6-155e-4789-b6c3-72d8fdb4b95a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.565059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.565919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.566111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.566385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] PATH_INFO: `/v3/projects/0b59a14644e440c88ca4e3483169e8d3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.574776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b59a14644e440c88ca4e3483169e8d3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.577022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.578133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c986dc-d6e5-4c1f-818c-e056ff043f33 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.593025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.593660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.594188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.594188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.594858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:23.595156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.600272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.632230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1038/2078] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:55:23.633382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.655059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2722323-93cd-4381-b59a-8b10f49055ae admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.671595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:23.675723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b59a14644e440c88ca4e3483169e8d3', 'request_id': 'req-36b4cbb0-8320-420a-bc7c-39c8f2d11211'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.686092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b59a14644e440c88ca4e3483169e8d3', 'request_id': 'req-36b4cbb0-8320-420a-bc7c-39c8f2d11211'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.713563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b59a14644e440c88ca4e3483169e8d3', 'request_id': 'req-36b4cbb0-8320-420a-bc7c-39c8f2d11211'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.727613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] The token cache is being invalidate because project 0b59a14644e440c88ca4e3483169e8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:23.727911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.728725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.730711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1041/2079] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:23 2022] DELETE /identity/v3/projects/0b59a14644e440c88ca4e3483169e8d3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:23.735115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.736563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:23.766911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.767551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.767811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.768134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.769178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.771043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.803344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1039/2080] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:23 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:23.808749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.810802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:23.827190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4cbb0-8320-420a-bc7c-39c8f2d11211 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.895666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.896447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.896823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.897094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] PATH_INFO: `/v3/users/3cc2baea9af3400496e25b0bda99075f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.898534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc2baea9af3400496e25b0bda99075f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.901281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.901579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93346a4d-9cbb-413a-8de5-e101eb390b5c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.907232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.908185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.909135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.909135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.909607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.911632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.948818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1040/2081] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:23 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:23.952965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.964546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da118-83c0-462e-9655-92f6e6d25654 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:23.970080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc2baea9af3400496e25b0bda99075f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.970531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:23.970766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc2baea9af3400496e25b0bda99075f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.972067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:23.972067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:23.972067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:23.972603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:23.974415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:23.983687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc2baea9af3400496e25b0bda99075f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.984691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc2baea9af3400496e25b0bda99075f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:23.986975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1041/2082] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:23.991861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:23.993624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.000857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc2baea9af3400496e25b0bda99075f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:24.013582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61d7f-16b3-485d-ad59-d30122fd86b0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.019357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71c502-4352-4820-a256-a7366ea91541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.019605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1042/2083] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:23 2022] DELETE /identity/v3/users/3cc2baea9af3400496e25b0bda99075f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:24.019958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c502-4352-4820-a256-a7366ea91541 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.020326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c502-4352-4820-a256-a7366ea91541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.020596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c502-4352-4820-a256-a7366ea91541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.021251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71c502-4352-4820-a256-a7366ea91541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.023324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71c502-4352-4820-a256-a7366ea91541 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.029327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:24.036828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1042/2084] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:24.040945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:24.046274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:24.123709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe256-2f58-4593-a725-497e88506f16 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.129578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.130400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.130783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.131076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] PATH_INFO: `/v3/projects/ba09ade491a24009b613c0a6f88a27ff/users/1d47cc17d36c427a9656ca9b2d319428/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.155279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba09ade491a24009b613c0a6f88a27ff, user_id=1d47cc17d36c427a9656ca9b2d319428, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.159222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.177222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1043/2085] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:24 2022] PUT /identity/v3/projects/ba09ade491a24009b613c0a6f88a27ff/users/1d47cc17d36c427a9656ca9b2d319428/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:24.188700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.188917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.191525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.233559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] MFA Rules not processed for user `1d47cc17d36c427a9656ca9b2d319428`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:24.235113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.316973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1043/2086] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:24.326208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:24.327980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.403778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:24.409983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.458108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaea93f-6ca4-4f7c-8a8a-d28f61de2cbb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.463076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e7d2a-d93e-4c28-8a33-f6d6715eb8e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.463877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e7d2a-d93e-4c28-8a33-f6d6715eb8e1 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.464209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e7d2a-d93e-4c28-8a33-f6d6715eb8e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.464556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e7d2a-d93e-4c28-8a33-f6d6715eb8e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.475895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e7d2a-d93e-4c28-8a33-f6d6715eb8e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.477538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e7d2a-d93e-4c28-8a33-f6d6715eb8e1 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.501370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1044/2087] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:24.532243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35fa0-5e65-44bb-8487-3f5c194cb723 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.542288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.556160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.556441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.557057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] PATH_INFO: `/v3/projects/a9e33a1b341f413a99e2bdf9cac529cc` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.559276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e33a1b341f413a99e2bdf9cac529cc)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.561393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.630825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e33a1b341f413a99e2bdf9cac529cc', 'request_id': 'req-7e13df0c-b745-40c0-8533-a0ad012c1d06'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:24.638641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e33a1b341f413a99e2bdf9cac529cc', 'request_id': 'req-7e13df0c-b745-40c0-8533-a0ad012c1d06'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:24.650289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e33a1b341f413a99e2bdf9cac529cc', 'request_id': 'req-7e13df0c-b745-40c0-8533-a0ad012c1d06'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:24.699241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] The token cache is being invalidate because project a9e33a1b341f413a99e2bdf9cac529cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:24.699768 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:24.700604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e13df0c-b745-40c0-8533-a0ad012c1d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:24.702713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1044/2088] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:24 2022] DELETE /identity/v3/projects/a9e33a1b341f413a99e2bdf9cac529cc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:24.711161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.711703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.711703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.734466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:24.742396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.815046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1045/2089] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:24.829368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668df88-7271-4605-8942-2afc6e094232 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.829685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668df88-7271-4605-8942-2afc6e094232 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.829951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668df88-7271-4605-8942-2afc6e094232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.868354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6668df88-7271-4605-8942-2afc6e094232 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:24.870079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6668df88-7271-4605-8942-2afc6e094232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.881819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1045/2090] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:24.885298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:24.898759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7c5e0-6ea7-4e79-8a7b-37f673c3c0e4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.906209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.907401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.907548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.907798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.908657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:24.908950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.911368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.925955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1046/2091] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:24.942059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668df88-7271-4605-8942-2afc6e094232 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:24.946385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668df88-7271-4605-8942-2afc6e094232 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.955570 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.956282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.956563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.956845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.957554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.960747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.980174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:25.011471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1046/2092] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:24 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:25.016518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:25.034866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c45c8-c8c7-4971-b63e-ef859546c2ae admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:25.066653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:25.167794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:25.168891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.169192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.169447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.170305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:25.172625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:25.205251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1047/2093] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:25 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:25.206699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:25.219803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811fd80-f7c5-4e5b-a79c-4c06ee2c03e7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:25.226127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:25.226896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.227173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.227443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.228137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:25.229703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:25.246462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1047/2094] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:25.248583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:25.260707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de4f21-d363-4fd8-973b-e6dcbe7a5916 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:25.267788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f850838-47fb-416f-bb3b-dcf3b87f0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:25.269212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f850838-47fb-416f-bb3b-dcf3b87f0c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.269509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f850838-47fb-416f-bb3b-dcf3b87f0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.269860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f850838-47fb-416f-bb3b-dcf3b87f0c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.270511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f850838-47fb-416f-bb3b-dcf3b87f0c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:25.272869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f850838-47fb-416f-bb3b-dcf3b87f0c0a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:25.289329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1048/2095] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:25.293633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:25.304319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c136-51a8-41a3-9bd0-44e39b74b21a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:25.309911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:25.310522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.310803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.311093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] PATH_INFO: `/v3/projects/20ce05a75d26416daef24eda2f27f8a0/users/aec9758b291d4c64b2e1f6dc3bbb08af/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.330353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ce05a75d26416daef24eda2f27f8a0, user_id=aec9758b291d4c64b2e1f6dc3bbb08af, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:25.334599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:25.359327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1048/2096] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:25 2022] PUT /identity/v3/projects/20ce05a75d26416daef24eda2f27f8a0/users/aec9758b291d4c64b2e1f6dc3bbb08af/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:25.365974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abedf-4974-405b-beef-5363aace4026 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.366608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abedf-4974-405b-beef-5363aace4026 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.366904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abedf-4974-405b-beef-5363aace4026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.397698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-452abedf-4974-405b-beef-5363aace4026 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:25.399733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-452abedf-4974-405b-beef-5363aace4026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:25.469755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1049/2097] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:25.480122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:25.481877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:25.559269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b029c-f88b-442a-a166-0fbfc1f24483 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:25.563082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:25.563677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.563956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.564226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.579699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:25.581334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:25.595099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1049/2098] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:26.424086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.425805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.426157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.457359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] MFA Rules not processed for user `aec9758b291d4c64b2e1f6dc3bbb08af`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:26.458966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:26.533474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1050/2099] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:26.537823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:26.548264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d6a87-b74a-4ada-b462-95c67a8741ff service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.552976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.553583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.553897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.554235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.554896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.557160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:26.591869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1050/2100] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:26 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:26.595890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:26.609755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148140e-9ab6-43f1-a2f3-c583770eacc9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.636381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:26.676544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.677290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.677476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.677697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.678372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.682103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:26.716818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1051/2101] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:26 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:26.718102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:26.730400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9376f-9e58-4b27-bba6-ec1b9961835b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.736687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.737300 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.737579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.737877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.738519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.740146 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:26.751708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1051/2102] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:26.756012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:26.766428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2740054-c73e-4543-a6e5-fdc97db3ca66 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.771792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.772490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.772766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.773127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] PATH_INFO: `/v3/projects/e8219fa9129b4e4ead09351eb12d4e77/users/863aae2462fb4cbd9f53b78a2637051e/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.790145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8219fa9129b4e4ead09351eb12d4e77, user_id=863aae2462fb4cbd9f53b78a2637051e, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.793238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:26.828517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1052/2103] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:26 2022] PUT /identity/v3/projects/e8219fa9129b4e4ead09351eb12d4e77/users/863aae2462fb4cbd9f53b78a2637051e/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:26.832694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:26.846606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0aaec-a4a8-4cf5-a947-cd737ad67d77 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.935794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf84b8-d570-460e-af7b-6e90596758b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.936437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf84b8-d570-460e-af7b-6e90596758b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.936725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf84b8-d570-460e-af7b-6e90596758b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.937157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf84b8-d570-460e-af7b-6e90596758b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.938034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf84b8-d570-460e-af7b-6e90596758b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.940012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf84b8-d570-460e-af7b-6e90596758b8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:26.955181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1052/2104] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:26.957160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:26.971325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d08f6-bdb8-43ce-9506-303594437d90 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.977377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.978112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.978394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.978673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] PATH_INFO: `/v3/projects/e8219fa9129b4e4ead09351eb12d4e77/users/863aae2462fb4cbd9f53b78a2637051e/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.980688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8219fa9129b4e4ead09351eb12d4e77, user_id=863aae2462fb4cbd9f53b78a2637051e, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.984243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:27.001540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1053/2105] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:26 2022] PUT /identity/v3/projects/e8219fa9129b4e4ead09351eb12d4e77/users/863aae2462fb4cbd9f53b78a2637051e/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:28.861561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:28.862011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:28.862137 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:28.903440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] MFA Rules not processed for user `863aae2462fb4cbd9f53b78a2637051e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:28.904860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:28.918821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:29.051272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1053/2106] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:29.063798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:29.065569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:29.170405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fb59-04cd-489f-a531-2c6e081f2a0a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:29.178260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:29.179213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:29.179496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:29.179857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:29.262436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:29.264273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:29.274679 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1054/2107] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:30.767297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:30.770102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:30.795416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:30.796946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:30.809496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98ae03-c400-420f-bb4c-390d183911fd service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:30.815083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:30.816255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:30.816757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:30.817128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:30.830297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:30.837790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:30.849447 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1055/2108] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:55:30.877085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ebc3-08c4-4e3d-863c-21b21469f625 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:30.881817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:30.882491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:30.882781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:30.883098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] PATH_INFO: `/v3/users/c31a0c08c7a249caadd609a3e772c1c2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:30.884225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31a0c08c7a249caadd609a3e772c1c2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:30.886193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:30.959006 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31a0c08c7a249caadd609a3e772c1c2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:30.969520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31a0c08c7a249caadd609a3e772c1c2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:30.970652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31a0c08c7a249caadd609a3e772c1c2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:30.992527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31a0c08c7a249caadd609a3e772c1c2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:30.993385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-51abf32e-92c5-4c4b-880f-ddf31c7dd6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31a0c08c7a249caadd609a3e772c1c2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:31.008027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1054/2109] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:30 2022] DELETE /identity/v3/users/c31a0c08c7a249caadd609a3e772c1c2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:31.252358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.266089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38f19a-4a14-4af2-80a5-fc7722b02256 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.305639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:31.374359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.375250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.375674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.376223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] PATH_INFO: `/v3/projects/1aa7cb99f3b44a85b984b80ad08e17c5` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.377725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa7cb99f3b44a85b984b80ad08e17c5)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.386705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.463837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa7cb99f3b44a85b984b80ad08e17c5', 'request_id': 'req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:31.473616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa7cb99f3b44a85b984b80ad08e17c5', 'request_id': 'req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:31.487138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa7cb99f3b44a85b984b80ad08e17c5', 'request_id': 'req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:31.501336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] The token cache is being invalidate because project 1aa7cb99f3b44a85b984b80ad08e17c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:31.501838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:31.503296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f3589e00-1293-4e86-842f-8b0d9c9f1a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:31.504849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1056/2110] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:31 2022] DELETE /identity/v3/projects/1aa7cb99f3b44a85b984b80ad08e17c5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:31.510219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.510512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.510899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.530627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:31.531896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:31.552343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:31.607679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1055/2111] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:31.615490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.615860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.616327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.640065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:31.641279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:31.650287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1057/2112] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:31.654795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.664737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95ae2f-5f77-417a-81e1-a4fcfa706886 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.670233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.670828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.671096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.671376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.672017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:31.672322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.673954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.688710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1056/2113] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:31.693691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.703979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dcc25-7b25-4c71-9810-97291ce4bd62 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.709924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.710598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.710876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.711146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.711788 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.713719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.749346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1058/2114] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:31 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:31.754322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.765933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a2d86-10f3-46e5-bdc6-ecdb0c0f6604 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.826401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.827099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.827281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.827599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.828226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.830208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.860157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1057/2115] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:31 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:31.864568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.875398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722b17-0bda-4f43-83f9-533e57d81637 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.880703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.881315 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.881594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.881924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.882615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.884297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.896326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1059/2116] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:31.900661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.912916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8bd07-b3b1-4174-ab40-174ede335408 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.918897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef5b9b-2bf9-40a1-8245-846ec35ae949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.919546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5b9b-2bf9-40a1-8245-846ec35ae949 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.919828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5b9b-2bf9-40a1-8245-846ec35ae949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.920094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5b9b-2bf9-40a1-8245-846ec35ae949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.920776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef5b9b-2bf9-40a1-8245-846ec35ae949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.922511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef5b9b-2bf9-40a1-8245-846ec35ae949 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.934496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1058/2117] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:55:31.939234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:31.949977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eec5e-d287-4a4d-bfba-57adc2ce0a3a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:31.955551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:31.956235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:31.956535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:31.956808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] PATH_INFO: `/v3/projects/81fc613102504ca1a7f12a1fceb2ed51/users/324325d907f244beb6862df4116f2c78/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:31.973570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fc613102504ca1a7f12a1fceb2ed51, user_id=324325d907f244beb6862df4116f2c78, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:31.976590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:31.995514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1060/2118] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:31 2022] PUT /identity/v3/projects/81fc613102504ca1a7f12a1fceb2ed51/users/324325d907f244beb6862df4116f2c78/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:32.000804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458090-96ea-48e5-9d47-d90f07592683 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:32.001114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458090-96ea-48e5-9d47-d90f07592683 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:32.001391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458090-96ea-48e5-9d47-d90f07592683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:32.022407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e1458090-96ea-48e5-9d47-d90f07592683 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:32.023681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1458090-96ea-48e5-9d47-d90f07592683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:32.085747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1059/2119] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:32.096121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:32.098479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:32.148971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:32.162644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274200d7-cdb2-414b-89b5-34e745bd86c2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:32.167165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:32.167784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:32.168076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:32.168343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:32.178653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:32.180349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:32.192210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1061/2120] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:37.159565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76995e-e3ae-429d-8079-9b19bae7a831 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:37.160369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76995e-e3ae-429d-8079-9b19bae7a831 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:37.160642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76995e-e3ae-429d-8079-9b19bae7a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:37.189478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7f76995e-e3ae-429d-8079-9b19bae7a831 None None] MFA Rules not processed for user `324325d907f244beb6862df4116f2c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:37.190723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f76995e-e3ae-429d-8079-9b19bae7a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:37.210540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:37.266892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1060/2121] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:37.281124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:37.282791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:37.378286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b125-c425-4954-9524-395eb94a4431 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:37.384366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5f5a-99e6-4ee9-944c-cb519282481c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:37.384981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5f5a-99e6-4ee9-944c-cb519282481c service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:37.385257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5f5a-99e6-4ee9-944c-cb519282481c service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:37.385528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5f5a-99e6-4ee9-944c-cb519282481c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:37.393523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5f5a-99e6-4ee9-944c-cb519282481c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:37.395208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5f5a-99e6-4ee9-944c-cb519282481c service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:37.406175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1062/2122] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:39.836107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:39.836580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:39.836669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:39.867727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] MFA Rules not processed for user `fc33c6252cf04fd984cdcfe3913e3dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:39.870904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:39.956060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1061/2123] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:40.071658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:40.072119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:40.072378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:40.106364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] MFA Rules not processed for user `324325d907f244beb6862df4116f2c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:40.107860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:40.115335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1063/2124] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:49.725795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:49.728207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:49.759225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ec95-f607-468c-8eb0-4114527d0722 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:49.764059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:49.764776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:49.765067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:49.765467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] PATH_INFO: `/v3/users/aec9758b291d4c64b2e1f6dc3bbb08af` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:49.766700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec9758b291d4c64b2e1f6dc3bbb08af)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:49.768695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:49.839904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec9758b291d4c64b2e1f6dc3bbb08af'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:49.858292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec9758b291d4c64b2e1f6dc3bbb08af'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:49.859024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec9758b291d4c64b2e1f6dc3bbb08af'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:49.876125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec9758b291d4c64b2e1f6dc3bbb08af'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:49.877158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec9758b291d4c64b2e1f6dc3bbb08af'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:49.892055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1062/2125] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:49 2022] DELETE /identity/v3/users/aec9758b291d4c64b2e1f6dc3bbb08af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:50.075572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:50.090968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33139ee3-adf3-41d5-a4e8-4b9ab2f24470 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:50.162001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:50.162649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:50.162912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:50.163186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] PATH_INFO: `/v3/projects/20ce05a75d26416daef24eda2f27f8a0` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:50.164355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ce05a75d26416daef24eda2f27f8a0)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:50.166444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:50.216586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ce05a75d26416daef24eda2f27f8a0', 'request_id': 'req-d29dd616-1898-4751-a0ed-57f2a82c6f49'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.223085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ce05a75d26416daef24eda2f27f8a0', 'request_id': 'req-d29dd616-1898-4751-a0ed-57f2a82c6f49'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.231656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ce05a75d26416daef24eda2f27f8a0', 'request_id': 'req-d29dd616-1898-4751-a0ed-57f2a82c6f49'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.236709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:50.245601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] The token cache is being invalidate because project 20ce05a75d26416daef24eda2f27f8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:50.246216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.247088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.249704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1064/2126] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:50 2022] DELETE /identity/v3/projects/20ce05a75d26416daef24eda2f27f8a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:50.253553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:50.255054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:50.268365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45357-dc48-434c-816a-e1f8f476cc54 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:50.319777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:50.346575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:50.347019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:50.347337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:50.347693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] PATH_INFO: `/v3/users/863aae2462fb4cbd9f53b78a2637051e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:50.348950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] RBAC: Authorizing `identity:delete_user(user_id=863aae2462fb4cbd9f53b78a2637051e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:50.350930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:50.420549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863aae2462fb4cbd9f53b78a2637051e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.429601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863aae2462fb4cbd9f53b78a2637051e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.430200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863aae2462fb4cbd9f53b78a2637051e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.447906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863aae2462fb4cbd9f53b78a2637051e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.449207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3f92ae1c-2963-4846-8a1a-24b38979605b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863aae2462fb4cbd9f53b78a2637051e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.464759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1063/2127] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:50 2022] DELETE /identity/v3/users/863aae2462fb4cbd9f53b78a2637051e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:50.686964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:50.691361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:50.715039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dd616-1898-4751-a0ed-57f2a82c6f49 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:50.813054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:50.813800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:50.814099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:50.814706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] PATH_INFO: `/v3/projects/e8219fa9129b4e4ead09351eb12d4e77` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:50.818658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8219fa9129b4e4ead09351eb12d4e77)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:50.823934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:50.944726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8219fa9129b4e4ead09351eb12d4e77', 'request_id': 'req-7cd6b9a9-ef86-4a76-90e4-a8edec408155'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.952113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8219fa9129b4e4ead09351eb12d4e77', 'request_id': 'req-7cd6b9a9-ef86-4a76-90e4-a8edec408155'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.960988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8219fa9129b4e4ead09351eb12d4e77', 'request_id': 'req-7cd6b9a9-ef86-4a76-90e4-a8edec408155'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.973940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] The token cache is being invalidate because project e8219fa9129b4e4ead09351eb12d4e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:50.974213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.974888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7cd6b9a9-ef86-4a76-90e4-a8edec408155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:50.976758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1065/2128] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:50 2022] DELETE /identity/v3/projects/e8219fa9129b4e4ead09351eb12d4e77 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:50.981756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:50.982274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:50.982351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.009135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:51.009135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:51.082081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1064/2129] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:51.090783 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.091219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.091332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.113976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:51.115196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:51.123757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1066/2130] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:51.128132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.137781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685d43-fc07-4f9c-8de5-50fcdb05e319 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.142247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.142837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.143111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.143375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.144012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:51.144308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.145915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.157303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1065/2131] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:51.161547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.171241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962034e-0272-4aff-ba59-6bda8aa2a2aa None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.177577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.178227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.178497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.178745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.179386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.181339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.212340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1067/2132] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:51 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:51.216560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.226766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395aa94-cd82-4827-adbf-67f69fcbcbcb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.272567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:51.288800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.289417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.289694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.289996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.290626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.292553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.321091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1066/2133] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:51 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:51.327343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.340909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db93ff-3fc8-488c-9eb8-64c886344cec admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.346214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.346808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.347085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.347359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.347993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.349796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.359735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1068/2134] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:51.363653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.375066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff5cf6-deac-4d3a-af4e-02d2f11dc98a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.380174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a7951-0485-4a6f-a40a-141617839ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.380782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7951-0485-4a6f-a40a-141617839ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.381055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7951-0485-4a6f-a40a-141617839ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.381320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7951-0485-4a6f-a40a-141617839ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.382002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a7951-0485-4a6f-a40a-141617839ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.383587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a7951-0485-4a6f-a40a-141617839ad7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.395135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1067/2135] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:51.399510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.410296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af00f9-26ad-45a1-b7cd-1b32aa36c06e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.416239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.416901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.417177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.417446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] PATH_INFO: `/v3/projects/cd7daa38dfea4417a79e13085b151260/users/4fb6158b4f1946f3932a8110636b8286/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.433448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7daa38dfea4417a79e13085b151260, user_id=4fb6158b4f1946f3932a8110636b8286, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.436144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.450433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1069/2136] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:51 2022] PUT /identity/v3/projects/cd7daa38dfea4417a79e13085b151260/users/4fb6158b4f1946f3932a8110636b8286/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:51.462276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.462651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.463018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.501036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] MFA Rules not processed for user `4fb6158b4f1946f3932a8110636b8286`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:51.502258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:51.572524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1068/2137] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:51.583559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:51.585312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:51.611357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:51.645682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641a56a-11ff-414e-9fbe-faeed5128983 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:51.649943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab9f46-e0d5-467e-a9f0-b13fdb6aa219 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:51.650546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab9f46-e0d5-467e-a9f0-b13fdb6aa219 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:51.650828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab9f46-e0d5-467e-a9f0-b13fdb6aa219 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:51.651094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab9f46-e0d5-467e-a9f0-b13fdb6aa219 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:51.659833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab9f46-e0d5-467e-a9f0-b13fdb6aa219 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:51.661267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab9f46-e0d5-467e-a9f0-b13fdb6aa219 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:51.670762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1070/2138] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:59.797572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:59.799784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:59.875785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ccc0e-0df6-4fca-9c65-0b14262c993c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:59.880868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:59.881496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:59.881786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:59.882068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] PATH_INFO: `/v3/users/916341bb0a2145ccad3a58b9246810b5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:59.883251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916341bb0a2145ccad3a58b9246810b5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:59.885253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:59.937064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916341bb0a2145ccad3a58b9246810b5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:59.946635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916341bb0a2145ccad3a58b9246810b5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:59.947315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916341bb0a2145ccad3a58b9246810b5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:59.949485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:59.960989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916341bb0a2145ccad3a58b9246810b5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:59.961703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916341bb0a2145ccad3a58b9246810b5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:59.973707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1069/2139] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:59 2022] DELETE /identity/v3/users/916341bb0a2145ccad3a58b9246810b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:59.978274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:59.979385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:59.979385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.000919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:00.002164 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:00.062334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1071/2140] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:00.072719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.074201 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:00.133831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f233a-19d6-46df-9064-311813ce8992 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.138389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d14ee-30bc-4d93-aeab-224b7fdd4384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.138995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d14ee-30bc-4d93-aeab-224b7fdd4384 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.139268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d14ee-30bc-4d93-aeab-224b7fdd4384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.139531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d14ee-30bc-4d93-aeab-224b7fdd4384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.149320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d14ee-30bc-4d93-aeab-224b7fdd4384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.150868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d14ee-30bc-4d93-aeab-224b7fdd4384 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:00.160574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1070/2141] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:00.477677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.479252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:00.491698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52916a45-71a1-4ceb-9199-ab4d74279ef9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.497048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.497696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.498015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.498290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] PATH_INFO: `/v3/projects/24a5eccad43a4e3d9d7d6824ed44b9d7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.499514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a5eccad43a4e3d9d7d6824ed44b9d7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.501449 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:00.564688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a5eccad43a4e3d9d7d6824ed44b9d7', 'request_id': 'req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:00.571640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a5eccad43a4e3d9d7d6824ed44b9d7', 'request_id': 'req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:00.580959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a5eccad43a4e3d9d7d6824ed44b9d7', 'request_id': 'req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:00.591969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] The token cache is being invalidate because project 24a5eccad43a4e3d9d7d6824ed44b9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:00.592253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:00.592877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-3bf4a1fa-c9a8-4308-addf-97b7ac374c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:00.594411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1072/2142] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:00 2022] DELETE /identity/v3/projects/24a5eccad43a4e3d9d7d6824ed44b9d7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:00.599185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.599470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.599747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.619210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:00.620364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:00.693738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1071/2143] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:00.701664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.702033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.702303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.723511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:00.724826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:00.733064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1073/2144] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:00.737514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.747623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a449f6-133d-42d5-924f-17c4a796a66b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.752363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.752988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.753263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.753531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.754204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:00.754501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.756108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:00.768142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1072/2145] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:56:00.773666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.783455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce35b-7dd5-4f8b-a9fd-c347e77b5713 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.789148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.789798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.790119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.790376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.791017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.792955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:00.823219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1074/2146] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:00 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:56:00.831535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.842880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8574a-d184-43fa-97f2-59d9ed3f8dcf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.904005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.904525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.904793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.905060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.905685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.907621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:00.917417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:00.930762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1073/2147] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:00 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:00.935232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.946462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed335-c961-4b6c-92a6-d24dc8ae152d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.951895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.952492 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.952767 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.953115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.953893 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.955511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:00.966068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1075/2148] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:00.970063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:00.980907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28398-ac47-4ca0-9ea6-ff4c638f4b11 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:00.986345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5e233-2576-40f9-880e-618f31690464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:00.986943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e233-2576-40f9-880e-618f31690464 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:00.987216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e233-2576-40f9-880e-618f31690464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:00.987481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e233-2576-40f9-880e-618f31690464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:00.988122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e233-2576-40f9-880e-618f31690464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:00.989745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e233-2576-40f9-880e-618f31690464 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:01.000899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1074/2149] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:01.005106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:01.015782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a231d0f-ce5e-407d-a976-1d2223a61144 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:01.021166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:01.021809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:01.022126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:01.022389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] PATH_INFO: `/v3/projects/031be1534d4e4721a56e23b19ef58422/users/7e17f606ec6148e3beafb94e87997f8b/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:01.025689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:01.038500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=031be1534d4e4721a56e23b19ef58422, user_id=7e17f606ec6148e3beafb94e87997f8b, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:01.041564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:01.055582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1076/2150] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:01 2022] PUT /identity/v3/projects/031be1534d4e4721a56e23b19ef58422/users/7e17f606ec6148e3beafb94e87997f8b/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:01.127460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:01.127765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:01.128181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:01.156967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] MFA Rules not processed for user `7e17f606ec6148e3beafb94e87997f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:01.158140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:01.238699 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1075/2151] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:01.253106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:01.254988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:01.315537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc228-f65e-4d21-8a89-06cafd040f8c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:01.320198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139854-8503-423a-b1c8-11a4c3936702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:01.320821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139854-8503-423a-b1c8-11a4c3936702 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:01.321070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139854-8503-423a-b1c8-11a4c3936702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:01.321402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139854-8503-423a-b1c8-11a4c3936702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:01.330800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139854-8503-423a-b1c8-11a4c3936702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:01.332264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34139854-8503-423a-b1c8-11a4c3936702 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:01.341267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1077/2152] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:03.911762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:03.980161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ca0f-b61f-4b70-a1ee-d29f595362ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:03.985092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:03.985731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:03.986040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:03.986305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] PATH_INFO: `/v3/users/7e17f606ec6148e3beafb94e87997f8b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:03.987448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e17f606ec6148e3beafb94e87997f8b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:03.989421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:04.040375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e17f606ec6148e3beafb94e87997f8b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.048722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e17f606ec6148e3beafb94e87997f8b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.049276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e17f606ec6148e3beafb94e87997f8b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.061606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e17f606ec6148e3beafb94e87997f8b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.062475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e17f606ec6148e3beafb94e87997f8b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.064613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:04.077102 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1076/2153] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:03 2022] DELETE /identity/v3/users/7e17f606ec6148e3beafb94e87997f8b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:04.081983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:04.082514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:04.082514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:04.103353 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:04.104590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:04.170830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1078/2154] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:04.180709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:04.182621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:04.249245 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb809c0f-3d8a-411b-b1b7-826ce3c12d8b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:04.253367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19fae1-f8b0-49ea-a52a-9508d06d6cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:04.254007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19fae1-f8b0-49ea-a52a-9508d06d6cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:04.254281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19fae1-f8b0-49ea-a52a-9508d06d6cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:04.254549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19fae1-f8b0-49ea-a52a-9508d06d6cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:04.264313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19fae1-f8b0-49ea-a52a-9508d06d6cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:04.265745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19fae1-f8b0-49ea-a52a-9508d06d6cb0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:04.277824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1077/2155] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:04.699847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:04.701390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:04.714420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4106c1-eaff-47eb-8073-d068b2a85013 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:04.720143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:04.720945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:04.721220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:04.721484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] PATH_INFO: `/v3/projects/031be1534d4e4721a56e23b19ef58422` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:04.722737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031be1534d4e4721a56e23b19ef58422)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:04.724750 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:04.775394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031be1534d4e4721a56e23b19ef58422', 'request_id': 'req-16e8d54a-2d60-480e-abf0-cb72b8facdd7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.782077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031be1534d4e4721a56e23b19ef58422', 'request_id': 'req-16e8d54a-2d60-480e-abf0-cb72b8facdd7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.790601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031be1534d4e4721a56e23b19ef58422', 'request_id': 'req-16e8d54a-2d60-480e-abf0-cb72b8facdd7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.801704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] The token cache is being invalidate because project 031be1534d4e4721a56e23b19ef58422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:04.802077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.802747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16e8d54a-2d60-480e-abf0-cb72b8facdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:04.804263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1079/2156] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:04 2022] DELETE /identity/v3/projects/031be1534d4e4721a56e23b19ef58422 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:04.810236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:04.810384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:04.810837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:04.831520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:04.832715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:04.902071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1078/2157] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:04.909744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:04.910050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:04.910321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:04.930098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:04.931334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:04.940181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1080/2158] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:04.945269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:04.958116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3d59-48e8-4f83-8231-c5cac896dc10 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:04.967385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:04.968281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:04.968749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:04.969098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:04.970238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:04.970533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:04.972118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:04.985110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1079/2159] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:56:04.989650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:04.995337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:04.999213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3ea79-379f-44ed-8d59-99d3852e4dea None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:05.006014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:05.006707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.007004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.007495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.008170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:05.010602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:05.043453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1081/2160] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:04 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:05.049031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:05.063674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a5ef-d391-4a63-b3f7-cf501d38b735 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:05.123773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:05.124381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.124654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.124911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.125532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:05.127521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:05.150892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1080/2161] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:05 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:05.154548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:05.166055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7adf3-6a7a-4a5a-ab76-cfa366a567f3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:05.171911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:05.172688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.172967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.173233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.173904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:05.175519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:05.191365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1082/2162] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:05.194946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:05.205496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ea7d-f0c5-42cd-a7cc-c04aaa91602e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:05.210654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356776-08cf-4db7-a92b-b9ea2549b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:05.211246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356776-08cf-4db7-a92b-b9ea2549b535 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.211529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356776-08cf-4db7-a92b-b9ea2549b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.212262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356776-08cf-4db7-a92b-b9ea2549b535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.212627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c356776-08cf-4db7-a92b-b9ea2549b535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:05.218512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c356776-08cf-4db7-a92b-b9ea2549b535 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:05.227618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:05.234177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1081/2163] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:05.235655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:05.248211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0c2f0-1fa2-49e2-8472-7241e087eea3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:05.253885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:05.255193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.255474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.255748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] PATH_INFO: `/v3/projects/6edee50c9ca84b43b58209073abb6642/users/1847928c4aa04730a897f38ac67d7071/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.274665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edee50c9ca84b43b58209073abb6642, user_id=1847928c4aa04730a897f38ac67d7071, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:05.277759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:05.293930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1083/2164] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:05 2022] PUT /identity/v3/projects/6edee50c9ca84b43b58209073abb6642/users/1847928c4aa04730a897f38ac67d7071/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:56:05.299727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.300340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.300876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.322958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:05.324140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:05.385719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1082/2165] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:05.397289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:05.399715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:05.500972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af49e9-ec49-4f67-b9a7-dcb51873c290 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:05.506422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152891f-4e65-40e2-90a0-8b59990fc5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:05.508331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152891f-4e65-40e2-90a0-8b59990fc5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:05.508619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152891f-4e65-40e2-90a0-8b59990fc5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:05.508920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152891f-4e65-40e2-90a0-8b59990fc5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:05.521576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152891f-4e65-40e2-90a0-8b59990fc5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:05.523108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152891f-4e65-40e2-90a0-8b59990fc5f2 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:05.533927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1084/2166] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:08.104459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:08.107357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:08.133695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e1e1f-d66c-4f09-9d68-6527560ac588 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:08.138885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:08.139810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:08.140092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:08.140365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] PATH_INFO: `/v3/users/1d47cc17d36c427a9656ca9b2d319428` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:08.141532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d47cc17d36c427a9656ca9b2d319428)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:08.144187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:08.224679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d47cc17d36c427a9656ca9b2d319428'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:08.237525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d47cc17d36c427a9656ca9b2d319428'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:08.238295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d47cc17d36c427a9656ca9b2d319428'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:08.262377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d47cc17d36c427a9656ca9b2d319428'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:08.263422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d47cc17d36c427a9656ca9b2d319428'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:08.285299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1083/2167] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:08 2022] DELETE /identity/v3/users/1d47cc17d36c427a9656ca9b2d319428 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:08.289798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:08.290390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:08.290390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:08.331268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:08.332675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:08.455185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1085/2168] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:08.456054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:08.457571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:08.609893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836caa81-3404-4c00-81c0-6c60699a0b52 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:08.615635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b66693-b7ed-44bf-9650-c04831b9c226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:08.616281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66693-b7ed-44bf-9650-c04831b9c226 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:08.616557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66693-b7ed-44bf-9650-c04831b9c226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:08.616824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66693-b7ed-44bf-9650-c04831b9c226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:08.627838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b66693-b7ed-44bf-9650-c04831b9c226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:08.629375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b66693-b7ed-44bf-9650-c04831b9c226 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:08.644838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1084/2169] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:09.168943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:09.171193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:09.199379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7644f1-1824-4d3d-b0d8-cc2f6f7b99bf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:09.213227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:09.213951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:09.214238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:09.214515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] PATH_INFO: `/v3/projects/ba09ade491a24009b613c0a6f88a27ff` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:09.217592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba09ade491a24009b613c0a6f88a27ff)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:09.222589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:09.412043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:09.417448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba09ade491a24009b613c0a6f88a27ff', 'request_id': 'req-b3a39277-6719-4915-8131-349521a851d1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:09.435600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba09ade491a24009b613c0a6f88a27ff', 'request_id': 'req-b3a39277-6719-4915-8131-349521a851d1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:09.459399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba09ade491a24009b613c0a6f88a27ff', 'request_id': 'req-b3a39277-6719-4915-8131-349521a851d1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:09.484362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] The token cache is being invalidate because project ba09ade491a24009b613c0a6f88a27ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:09.484857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:09.486423 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b3a39277-6719-4915-8131-349521a851d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:09.489434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1086/2170] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:09 2022] DELETE /identity/v3/projects/ba09ade491a24009b613c0a6f88a27ff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:09.494507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:09.496635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:09.497075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:09.522544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:09.524187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:09.543987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:09.681289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1085/2171] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:09.687118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:09.687706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:09.688133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:09.760559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:09.766225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:09.795078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1087/2172] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:09.799948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:09.811545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdaec-9b95-4909-b292-6a8470bcf24a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:09.816432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:09.817084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:09.817356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:09.817656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:09.818428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:09.818732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:09.820425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:09.855303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1086/2173] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:56:09.856162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:09.875204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bc9f4-5811-4cc1-a390-b7aa9310a3cf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:09.882589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:09.883693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:09.884301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:09.884723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:09.885648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:09.888043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:09.927627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1088/2174] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:09 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:56:09.932602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:09.943944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a8eb7-b230-4883-b088-d00c2757b914 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:10.020550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:10.021178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:10.022241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:10.022588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:10.023298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:10.025492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:10.052710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1087/2175] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:09 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:10.056490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:10.069579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6b3d-3b97-4955-b79e-41006cfd2883 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:10.075503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:10.077748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:10.078253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:10.079068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:10.079742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:10.081426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:10.093690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1089/2176] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:10.097966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:10.109483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a685-0734-4ced-b202-0e5e536ea170 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:10.114793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca4d68-fe75-43b7-89df-110edb3ecb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:10.115330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca4d68-fe75-43b7-89df-110edb3ecb6d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:10.115704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca4d68-fe75-43b7-89df-110edb3ecb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:10.116077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca4d68-fe75-43b7-89df-110edb3ecb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:10.116849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca4d68-fe75-43b7-89df-110edb3ecb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:10.118651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca4d68-fe75-43b7-89df-110edb3ecb6d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:10.134171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1088/2177] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:10.135385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:10.150597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ece6c-72e4-4521-89e4-74b353aebf98 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:10.155969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:10.156900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:10.157365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:10.157840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] PATH_INFO: `/v3/projects/20376bc2dfc04833983c3e6884ce5b33/users/1f536b95299045288ad338622f2f827e/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:10.178672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20376bc2dfc04833983c3e6884ce5b33, user_id=1f536b95299045288ad338622f2f827e, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:10.181418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:10.197791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1090/2178] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:10 2022] PUT /identity/v3/projects/20376bc2dfc04833983c3e6884ce5b33/users/1f536b95299045288ad338622f2f827e/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:10.208760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbfa09-e5d8-48d7-bf94-5f843a57a88b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:10.209567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbfa09-e5d8-48d7-bf94-5f843a57a88b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:10.209976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbfa09-e5d8-48d7-bf94-5f843a57a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:10.242220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6cbbfa09-e5d8-48d7-bf94-5f843a57a88b None None] MFA Rules not processed for user `1f536b95299045288ad338622f2f827e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:10.243639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6cbbfa09-e5d8-48d7-bf94-5f843a57a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:10.332652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1089/2179] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:10.348458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:10.350673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:10.425812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5cbe-a854-4256-851a-8ebadd3da8f3 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:10.430146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:10.430815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:10.431092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:10.431365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:10.441633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:10.443479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:10.453624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1091/2180] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:12.028964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.029496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.029603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.058467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:12.067666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] MFA Rules not processed for user `1847928c4aa04730a897f38ac67d7071`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:12.069467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:12.146790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1090/2181] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:12.147294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:12.148886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:12.221394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f607de1-8c4b-4543-a9b5-68d1266ec4f8 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:12.225972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:12.226595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.226877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.227149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.227842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:12.229780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:12.251907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:12.261973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1092/2182] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:12 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:56:12.264890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:12.276869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd72e-6a10-4f6c-bd54-c5707bcd41b6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:12.338276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:12.338884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.339158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.339425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.340054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:12.342039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:12.365080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1091/2183] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:12 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:12.369522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:12.381509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bb2d3-2581-4ffc-936c-7d5db8b50cdb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:12.386254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:12.386859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.387143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.387413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.388046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:12.389652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:12.401602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1093/2184] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:12.406433 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:12.418970 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7907b-6b1a-43f9-852a-9e14b29909f2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:12.424928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:12.425934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.426268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.426534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] PATH_INFO: `/v3/projects/1b0fb1f1aa974bef8f4c0523551e6fab/users/fecf60d3fd6a4fd3b131e304ba0820e3/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.446064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0fb1f1aa974bef8f4c0523551e6fab, user_id=fecf60d3fd6a4fd3b131e304ba0820e3, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:12.448829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:12.470757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1092/2185] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:12 2022] PUT /identity/v3/projects/1b0fb1f1aa974bef8f4c0523551e6fab/users/fecf60d3fd6a4fd3b131e304ba0820e3/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:12.474957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:12.485108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6809-0431-4d07-8d05-9d13d078e29a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:12.542993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc5f55-6b06-47d2-961e-8050ea5ce8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:12.543623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc5f55-6b06-47d2-961e-8050ea5ce8de admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.543875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc5f55-6b06-47d2-961e-8050ea5ce8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.544146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc5f55-6b06-47d2-961e-8050ea5ce8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.544772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc5f55-6b06-47d2-961e-8050ea5ce8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:12.546415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc5f55-6b06-47d2-961e-8050ea5ce8de admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:12.558406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1094/2186] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:12.564687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:12.575819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a51134-5a7d-44b9-8451-df2d90b27e49 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:12.580936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:12.581624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:12.581938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:12.582218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] PATH_INFO: `/v3/projects/1b0fb1f1aa974bef8f4c0523551e6fab/users/fecf60d3fd6a4fd3b131e304ba0820e3/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:12.584158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0fb1f1aa974bef8f4c0523551e6fab, user_id=fecf60d3fd6a4fd3b131e304ba0820e3, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:12.586952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:12.598973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1093/2187] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:12 2022] PUT /identity/v3/projects/1b0fb1f1aa974bef8f4c0523551e6fab/users/fecf60d3fd6a4fd3b131e304ba0820e3/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:14.265431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d00b-9849-4533-8127-237ea0443f2b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:14.265949 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d00b-9849-4533-8127-237ea0443f2b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:14.266236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d00b-9849-4533-8127-237ea0443f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:14.302317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2221d00b-9849-4533-8127-237ea0443f2b None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:14.305443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2221d00b-9849-4533-8127-237ea0443f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:14.445567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1095/2188] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:14.507461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:14.514629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:14.672894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:14.713001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccbbf7-0382-442f-a34f-122092ba52a1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:14.724706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:14.728747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:14.729059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:14.729330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:14.750222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:14.752446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:14.776572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1094/2189] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:56:20.000525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234f86-e9a8-4051-b173-f33ec8272778 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.001488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234f86-e9a8-4051-b173-f33ec8272778 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.001962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234f86-e9a8-4051-b173-f33ec8272778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.062063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-73234f86-e9a8-4051-b173-f33ec8272778 None None] MFA Rules not processed for user `fecf60d3fd6a4fd3b131e304ba0820e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:20.063814 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-73234f86-e9a8-4051-b173-f33ec8272778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.222506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1096/2190] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:20.236645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.238515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.411706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad51187-e78e-4b5c-b0fa-36231c74d637 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.418451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.420186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.421236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.421918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.566340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.568313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.579341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1095/2191] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:20.879398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.883968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.884258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.948540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:20.950989 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.973069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1097/2192] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:20.980278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.996238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694529e-fee9-4cbd-a3a1-e8163d18ab0a service glance] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:21.002425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e05e-3a06-4ddc-89d8-d9edab8720b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:21.003239 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e05e-3a06-4ddc-89d8-d9edab8720b6 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:21.003613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e05e-3a06-4ddc-89d8-d9edab8720b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:21.004402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e05e-3a06-4ddc-89d8-d9edab8720b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:21.029027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e05e-3a06-4ddc-89d8-d9edab8720b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:21.030837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e05e-3a06-4ddc-89d8-d9edab8720b6 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:21.042438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1096/2193] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:56:22.021316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:22.023048 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:22.033947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:22.178156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bd76c-6bcf-4b59-b725-0e75976c30f8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:22.185261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:22.186393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:22.186895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:22.187384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] PATH_INFO: `/v3/users/4fb6158b4f1946f3932a8110636b8286` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:22.188937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb6158b4f1946f3932a8110636b8286)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:22.191266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:22.310671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb6158b4f1946f3932a8110636b8286'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:22.311626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb6158b4f1946f3932a8110636b8286'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:22.327355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb6158b4f1946f3932a8110636b8286'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:22.328397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb6158b4f1946f3932a8110636b8286'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:22.352082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb6158b4f1946f3932a8110636b8286'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:22.382089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1098/2194] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:22 2022] DELETE /identity/v3/users/4fb6158b4f1946f3932a8110636b8286 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:22.386722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:22.387346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:22.387346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:22.427635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:22.428928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:22.574927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1097/2195] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:22.585374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:22.586876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:22.716820 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90166e76-d564-4606-9601-a4cfd783f770 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:22.726704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628f1c0-b155-4473-9f67-73cedce87353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:22.728033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f1c0-b155-4473-9f67-73cedce87353 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:22.728737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f1c0-b155-4473-9f67-73cedce87353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:22.729223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f1c0-b155-4473-9f67-73cedce87353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:22.768471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628f1c0-b155-4473-9f67-73cedce87353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:22.779865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628f1c0-b155-4473-9f67-73cedce87353 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:22.818911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1099/2196] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:23.383285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:23.385785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:23.420031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89ad5-0072-498c-8372-04943afaa721 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:23.440039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:23.440737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:23.441089 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:23.441262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] PATH_INFO: `/v3/projects/cd7daa38dfea4417a79e13085b151260` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:23.442542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7daa38dfea4417a79e13085b151260)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:23.444591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:23.502039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:23.562037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7daa38dfea4417a79e13085b151260', 'request_id': 'req-3fd75515-cadb-4343-bc78-09ccbc2d7acc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:23.577399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7daa38dfea4417a79e13085b151260', 'request_id': 'req-3fd75515-cadb-4343-bc78-09ccbc2d7acc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:23.593387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7daa38dfea4417a79e13085b151260', 'request_id': 'req-3fd75515-cadb-4343-bc78-09ccbc2d7acc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:23.639354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] The token cache is being invalidate because project cd7daa38dfea4417a79e13085b151260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:23.640036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:23.640956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3fd75515-cadb-4343-bc78-09ccbc2d7acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:23.647182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1098/2197] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:23 2022] DELETE /identity/v3/projects/cd7daa38dfea4417a79e13085b151260 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:23.653493 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:23.654227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:23.654227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:23.691453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:23.692680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:23.737143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:23.791498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1100/2198] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:23.801466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:23.801466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:23.801466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:23.831404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:23.831404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:23.881495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1099/2199] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:23.881747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:23.903295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b002bf-999f-4b83-ae31-aac2ccba47ff None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:23.942702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:23.946683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:23.946971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:23.947242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:23.947932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:23.948233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:23.963257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:24.045225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:24.058683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1101/2200] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:56:24.062933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81834a47-c3cb-41f4-9f70-47a94a50758c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:24.098737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:24.099820 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:24.101963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:24.109014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:24.113901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:24.123708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:24.203182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1100/2201] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:24 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:24.207127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:24.224149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff215-85ca-44e5-9971-9864aaf06c9f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:24.359454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:24.360526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:24.360995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:24.361752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:24.362638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:24.373065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:24.409336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1102/2202] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:24 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:24.411803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:24.428231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78caf2d-a6bc-423a-8da8-efd29aa867a6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:24.453571 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:24.456804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:24.457557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:24.458694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:24.461002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:24.466154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:24.489521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1101/2203] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:24.502363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:24.548284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62d9a-f9d4-4dac-8b56-167068049baf admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:24.587115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394c3e4-0ef0-4539-a6c1-09b1f25ea032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:24.619250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394c3e4-0ef0-4539-a6c1-09b1f25ea032 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:24.619250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394c3e4-0ef0-4539-a6c1-09b1f25ea032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:24.619250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394c3e4-0ef0-4539-a6c1-09b1f25ea032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:24.619250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394c3e4-0ef0-4539-a6c1-09b1f25ea032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:24.619250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394c3e4-0ef0-4539-a6c1-09b1f25ea032 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:24.659182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:24.676264 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1103/2204] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:24.709417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404953-f81c-4e45-b85d-d51c5acbbff0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:24.729972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:24.729972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:24.729972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:24.729972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] PATH_INFO: `/v3/projects/dec1e95f67cb4ec48c5741475828db91/users/9ca28332a4944d5a8d64085e4148b649/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:24.798947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec1e95f67cb4ec48c5741475828db91, user_id=9ca28332a4944d5a8d64085e4148b649, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:24.809010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:24.886602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1102/2205] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:24 2022] PUT /identity/v3/projects/dec1e95f67cb4ec48c5741475828db91/users/9ca28332a4944d5a8d64085e4148b649/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:56:24.918794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa41f3-ca07-4fe3-9044-d29bd91c593c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:24.919029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa41f3-ca07-4fe3-9044-d29bd91c593c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:24.919291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa41f3-ca07-4fe3-9044-d29bd91c593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:24.961623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-defa41f3-ca07-4fe3-9044-d29bd91c593c None None] MFA Rules not processed for user `9ca28332a4944d5a8d64085e4148b649`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:24.963066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-defa41f3-ca07-4fe3-9044-d29bd91c593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:25.040595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1104/2206] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:25.055147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:25.059688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:25.279864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3ed3-f0cc-4983-8d44-d6ef77def176 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:25.284986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d942b-6d3c-420f-bf34-f9a2ee866ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:25.289011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d942b-6d3c-420f-bf34-f9a2ee866ece service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:25.289550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d942b-6d3c-420f-bf34-f9a2ee866ece service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:25.290084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d942b-6d3c-420f-bf34-f9a2ee866ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:25.314382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d942b-6d3c-420f-bf34-f9a2ee866ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:25.315894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d942b-6d3c-420f-bf34-f9a2ee866ece service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:25.342617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1103/2207] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:27.103888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394443-9899-4d4e-aa86-cdcc436d48b1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:27.104907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394443-9899-4d4e-aa86-cdcc436d48b1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:27.105418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394443-9899-4d4e-aa86-cdcc436d48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:27.140203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8b394443-9899-4d4e-aa86-cdcc436d48b1 None None] MFA Rules not processed for user `9ca28332a4944d5a8d64085e4148b649`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:27.147027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b394443-9899-4d4e-aa86-cdcc436d48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:27.165109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1105/2208] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:34.918603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a142a8-632f-440b-94b3-205f1b9a726c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:34.920209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a142a8-632f-440b-94b3-205f1b9a726c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:34.920669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a142a8-632f-440b-94b3-205f1b9a726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:34.965478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e1a142a8-632f-440b-94b3-205f1b9a726c None None] MFA Rules not processed for user `1847928c4aa04730a897f38ac67d7071`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:34.966794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1a142a8-632f-440b-94b3-205f1b9a726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:35.092957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:35.138401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1104/2209] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:35.875892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:35.876420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:35.876420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:35.941498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] MFA Rules not processed for user `73f1b9e32ad3493284c5df45afd042fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:35.945118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:35.982168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:36.080473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1106/2210] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:41.013809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0533f0-f930-404f-9f41-a6477503c1f9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:41.014401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0533f0-f930-404f-9f41-a6477503c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:41.014557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0533f0-f930-404f-9f41-a6477503c1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:41.037250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-aa0533f0-f930-404f-9f41-a6477503c1f9 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:41.038578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aa0533f0-f930-404f-9f41-a6477503c1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:41.101613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1105/2211] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:41.114081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:41.115654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:41.196013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068a5cc-189f-410e-a53e-4324bee3672f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:41.201518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:41.202173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:41.202452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:41.202727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:41.212393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:41.215214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:41.224464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1107/2212] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:56:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:56:48.529057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:48.529583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:48.529583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:48.550584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:48.551814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:48.566468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1106/2213] 10.222.0.75 () {58 vars in 967 bytes} [Wed Aug 31 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:48.584612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:48.603757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f427cc-0f9f-471d-a6b4-2d880e9e128d service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:48.612804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:48.613441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:48.613719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:48.614025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:48.624022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:48.625659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:48.635138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1108/2214] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:56:50.907629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:50.909210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:50.986566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9439f9-4608-4196-9d5c-fe80eea59bf6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:50.991722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:50.992365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:50.992635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:50.992900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] PATH_INFO: `/v3/users/fc33c6252cf04fd984cdcfe3913e3dcc` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:50.994227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc33c6252cf04fd984cdcfe3913e3dcc)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:50.996216 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.045304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc33c6252cf04fd984cdcfe3913e3dcc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.054188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc33c6252cf04fd984cdcfe3913e3dcc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.054809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc33c6252cf04fd984cdcfe3913e3dcc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.070782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc33c6252cf04fd984cdcfe3913e3dcc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.071521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-129773d6-15b6-45de-8b4e-4f08ba3043b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc33c6252cf04fd984cdcfe3913e3dcc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.091739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1107/2215] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:50 2022] DELETE /identity/v3/users/fc33c6252cf04fd984cdcfe3913e3dcc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:56:51.279322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.293433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75516a64-ad06-4fd5-84c6-a924712f4ca3 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.403441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.404103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.404377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.404646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] PATH_INFO: `/v3/projects/c7fb12ca0da546dcbcff810209d6fc40` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.406050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fb12ca0da546dcbcff810209d6fc40)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.409137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.464549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:51.473109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fb12ca0da546dcbcff810209d6fc40', 'request_id': 'req-785c8af3-0cd0-4b63-8cf7-403e539db32b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.483159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fb12ca0da546dcbcff810209d6fc40', 'request_id': 'req-785c8af3-0cd0-4b63-8cf7-403e539db32b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.496153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fb12ca0da546dcbcff810209d6fc40', 'request_id': 'req-785c8af3-0cd0-4b63-8cf7-403e539db32b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.511791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] The token cache is being invalidate because project c7fb12ca0da546dcbcff810209d6fc40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:51.512091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.512964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-785c8af3-0cd0-4b63-8cf7-403e539db32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:51.514733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1109/2216] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:51 2022] DELETE /identity/v3/projects/c7fb12ca0da546dcbcff810209d6fc40 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:51.519922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.520224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.520524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.545422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:51.546712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:51.551606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:51.625801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1108/2217] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:51.633055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.633336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.633603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.654950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:51.656517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:51.668044 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1110/2218] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:51.672475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.684492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be32a0-8ecb-4a85-81ba-1c1a28499f50 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.689374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.690203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.690380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.690654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.691461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:51.691658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.693235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.710627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1109/2219] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:56:51.711754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.721633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c9ff-5ea3-45e3-b6e1-ef9791666724 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.727034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.727655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.727967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.728237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.728901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.730891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.764894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1111/2220] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:51 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:56:51.766189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.777101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fb0c3-f9fd-48ca-baa0-5bb7507fcc1e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.837936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.838270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.838541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.838808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.839607 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.841544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.869565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1110/2221] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:51 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:56:51.873810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.885076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aa42a-c823-4a44-b6f5-1dd911bb379d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.890010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.890654 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.890930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.891200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.891872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.893497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.905756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1112/2222] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:56:51.909492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.920341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7726-d765-49a2-8005-9af6a2cabe67 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.926230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a641d8-37b0-407a-ad7e-69a3ecde7ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.927011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a641d8-37b0-407a-ad7e-69a3ecde7ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.927292 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a641d8-37b0-407a-ad7e-69a3ecde7ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.927558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a641d8-37b0-407a-ad7e-69a3ecde7ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.928205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a641d8-37b0-407a-ad7e-69a3ecde7ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.929861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a641d8-37b0-407a-ad7e-69a3ecde7ca9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:51.945158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1111/2223] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:51.946546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:51.958630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a80c8-6d41-4d15-b1ce-1e158632ec3c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:51.963371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:51.964035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:51.964400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:51.964582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] PATH_INFO: `/v3/projects/6384e75684524ff0926291d668776e30/users/2b8ecb9f1f3045babc8e586697d62c4f/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:51.983770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6384e75684524ff0926291d668776e30, user_id=2b8ecb9f1f3045babc8e586697d62c4f, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:51.986627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:52.006646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1113/2224] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:51 2022] PUT /identity/v3/projects/6384e75684524ff0926291d668776e30/users/2b8ecb9f1f3045babc8e586697d62c4f/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:52.019954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:52.020250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:52.020566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:52.064674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] MFA Rules not processed for user `2b8ecb9f1f3045babc8e586697d62c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:52.066056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:52.131689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1112/2225] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:52.143107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:52.146470 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:52.211501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47f53f-121d-42de-a85c-ca3e513724b8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:52.217704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096090ae-986e-4a79-8fee-2ed0081b4283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:52.218784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096090ae-986e-4a79-8fee-2ed0081b4283 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:52.219253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096090ae-986e-4a79-8fee-2ed0081b4283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:52.219910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096090ae-986e-4a79-8fee-2ed0081b4283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:52.230477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096090ae-986e-4a79-8fee-2ed0081b4283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:52.231911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096090ae-986e-4a79-8fee-2ed0081b4283 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:52.241118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1114/2226] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:52.266877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:52.273475 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:52.339204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c0e1c-1083-4023-a137-b0cada13557e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:52.344529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:52.345179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:52.345456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:52.345718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] PATH_INFO: `/v3/users/2b8ecb9f1f3045babc8e586697d62c4f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:52.347254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8ecb9f1f3045babc8e586697d62c4f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:52.349095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:52.402997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8ecb9f1f3045babc8e586697d62c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:52.412269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8ecb9f1f3045babc8e586697d62c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:52.413222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8ecb9f1f3045babc8e586697d62c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:52.426261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8ecb9f1f3045babc8e586697d62c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:52.426911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8ecb9f1f3045babc8e586697d62c4f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:52.445344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1113/2227] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:52 2022] DELETE /identity/v3/users/2b8ecb9f1f3045babc8e586697d62c4f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:52.450546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:52.451068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:52.451479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:52.472076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:52.473306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:52.538039 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1115/2228] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:52.548230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:52.549887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:52.650965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677594a5-8c08-479b-86d1-30a42b0c3c11 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:52.654588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da212-f660-4732-a800-764993fdb657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:52.655939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da212-f660-4732-a800-764993fdb657 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:52.655939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da212-f660-4732-a800-764993fdb657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:52.655939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da212-f660-4732-a800-764993fdb657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:52.667473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099da212-f660-4732-a800-764993fdb657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:52.669297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099da212-f660-4732-a800-764993fdb657 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:52.682659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1114/2229] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:52.989702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:52.990840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:53.014415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19118c57-f824-4995-83f1-52ec5772c577 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.027140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.027804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.028085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.028357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] PATH_INFO: `/v3/projects/6384e75684524ff0926291d668776e30` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.034612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6384e75684524ff0926291d668776e30)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.037637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.040856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:53.124651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6384e75684524ff0926291d668776e30', 'request_id': 'req-189528e5-ee67-4cf3-9a84-1f148641c36a'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:53.137961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6384e75684524ff0926291d668776e30', 'request_id': 'req-189528e5-ee67-4cf3-9a84-1f148641c36a'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:53.150532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6384e75684524ff0926291d668776e30', 'request_id': 'req-189528e5-ee67-4cf3-9a84-1f148641c36a'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:53.166280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] The token cache is being invalidate because project 6384e75684524ff0926291d668776e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:53.166844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:53.167569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-189528e5-ee67-4cf3-9a84-1f148641c36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:53.169190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1116/2230] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:52 2022] DELETE /identity/v3/projects/6384e75684524ff0926291d668776e30 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:53.174301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.174800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.174914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.210856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:53.212054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:53.246175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:53.313262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1115/2231] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:53.315331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.315623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.316028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.337952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:53.339176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:53.347386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1117/2232] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:53.352141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.362999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47d2b5-2204-44e2-99a3-9c37118958b9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.368347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.369014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.369293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.369562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.370308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:53.370603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.372249 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.390282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1116/2233] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:56:53.391675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.402113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080ae0-b97c-4d9d-ad1e-154c7dbe168e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.407529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.408179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.408468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.408796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.409550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.411645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.443076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1118/2234] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:53 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:53.447624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.458562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44de01-c1b6-477f-86af-d27988c9e3a4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.520958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.521587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.521895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.522171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.522825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.524808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.553477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1117/2235] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:53 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:53.554968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.566977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d902bbc-88bb-45e7-96b6-eca7e140d482 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.573067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.573795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.574178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.574662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.575455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.577285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.595202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1119/2236] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:56:53.596076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.609279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29897-c482-473f-b699-1742b2ff4130 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.619555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8d96-f310-4c94-924e-af9e0b46fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.620413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8d96-f310-4c94-924e-af9e0b46fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.620876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8d96-f310-4c94-924e-af9e0b46fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.621222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8d96-f310-4c94-924e-af9e0b46fec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.621966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8d96-f310-4c94-924e-af9e0b46fec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.623736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8d96-f310-4c94-924e-af9e0b46fec4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.644509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1118/2237] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:53.645833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.659737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fc255-3a52-4b05-9dcf-a603abb8ea60 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.667712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.668495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.670165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.670644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] PATH_INFO: `/v3/projects/4ff7c6e80bed43ecbcf17e4fa1bad450/users/9cf2f9dbdcfe4cce91fd4c03cd8e8bba/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.690230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff7c6e80bed43ecbcf17e4fa1bad450, user_id=9cf2f9dbdcfe4cce91fd4c03cd8e8bba, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.694562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.714888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1120/2238] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:53 2022] PUT /identity/v3/projects/4ff7c6e80bed43ecbcf17e4fa1bad450/users/9cf2f9dbdcfe4cce91fd4c03cd8e8bba/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:53.724099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf313-52c5-4f2a-8f23-7dc130093669 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.724376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf313-52c5-4f2a-8f23-7dc130093669 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.724648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf313-52c5-4f2a-8f23-7dc130093669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.750752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e8ddf313-52c5-4f2a-8f23-7dc130093669 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:53.752678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8ddf313-52c5-4f2a-8f23-7dc130093669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:53.855220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1119/2239] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:53.865266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:53.867093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:53.925917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6d638-4e62-44b7-8c80-57615a4152e5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:53.929509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:53.930167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.930445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.930716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.941745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:53.943238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:53.954225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1121/2240] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:55.050151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca029af-d271-4f0c-88d7-f6a6851351e4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:55.050637 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca029af-d271-4f0c-88d7-f6a6851351e4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:55.050742 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca029af-d271-4f0c-88d7-f6a6851351e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:55.109172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cca029af-d271-4f0c-88d7-f6a6851351e4 None None] MFA Rules not processed for user `9cf2f9dbdcfe4cce91fd4c03cd8e8bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:55.110342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cca029af-d271-4f0c-88d7-f6a6851351e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:55.139533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:55.268188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1120/2241] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:55.280836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:55.282935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:55.338361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:55.388316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec716243-f623-4871-a753-902ded69cfe3 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:55.422465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8f86a-ce41-4f67-af5d-30fb7b923b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:55.425757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f86a-ce41-4f67-af5d-30fb7b923b62 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:55.427520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f86a-ce41-4f67-af5d-30fb7b923b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:55.428352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f86a-ce41-4f67-af5d-30fb7b923b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:55.456733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f86a-ce41-4f67-af5d-30fb7b923b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:55.465676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f86a-ce41-4f67-af5d-30fb7b923b62 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:55.494297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1122/2242] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:57.080067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:57.080690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:57.080985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:57.107791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] MFA Rules not processed for user `9cf2f9dbdcfe4cce91fd4c03cd8e8bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:57.108980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:57.117847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1121/2243] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:59.801943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c6c4-4803-4189-8b41-c0d17a750087 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:59.802505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c6c4-4803-4189-8b41-c0d17a750087 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:59.802505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c6c4-4803-4189-8b41-c0d17a750087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:59.822399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-04d5c6c4-4803-4189-8b41-c0d17a750087 None None] MFA Rules not processed for user `3dc4ac4ada004bbb942c36755f4a7cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:59.824200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-04d5c6c4-4803-4189-8b41-c0d17a750087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:59.893035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1123/2244] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:00.230098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:00.231631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:00.246007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f126852-1b3a-40f3-add6-b4f2c589af09 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:00.251473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:00.252108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:00.252379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:00.252642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] PATH_INFO: `/v3/users/1f536b95299045288ad338622f2f827e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:00.253932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f536b95299045288ad338622f2f827e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:00.255906 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:00.305290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f536b95299045288ad338622f2f827e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:00.314512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f536b95299045288ad338622f2f827e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:00.315255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f536b95299045288ad338622f2f827e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:00.328004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f536b95299045288ad338622f2f827e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:00.328919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f536b95299045288ad338622f2f827e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:00.343092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1122/2245] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:57:00 2022] DELETE /identity/v3/users/1f536b95299045288ad338622f2f827e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:00.347797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:00.348081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:00.348348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:00.367277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:00.368501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:00.429006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1124/2246] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:57:00.442510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:00.444335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:00.516214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31495f-a276-433b-873b-24f25222cbad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:00.521104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4741ae7-4482-43f0-94fe-73067531469c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:00.522120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4741ae7-4482-43f0-94fe-73067531469c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:00.522687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4741ae7-4482-43f0-94fe-73067531469c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:00.523160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4741ae7-4482-43f0-94fe-73067531469c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:00.535654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4741ae7-4482-43f0-94fe-73067531469c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:00.537732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4741ae7-4482-43f0-94fe-73067531469c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:00.554131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1123/2247] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:01.311683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:01.314595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:01.330591 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0da8-3d6e-4d1f-b243-19036cd9e0d6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:01.335978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:01.337029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:01.337529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:01.338105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] PATH_INFO: `/v3/projects/20376bc2dfc04833983c3e6884ce5b33` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:01.340341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20376bc2dfc04833983c3e6884ce5b33)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:01.342652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:01.452706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20376bc2dfc04833983c3e6884ce5b33', 'request_id': 'req-2ab18f8e-cb7c-425f-ac06-b208be847014'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:01.461142 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20376bc2dfc04833983c3e6884ce5b33', 'request_id': 'req-2ab18f8e-cb7c-425f-ac06-b208be847014'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:01.474522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20376bc2dfc04833983c3e6884ce5b33', 'request_id': 'req-2ab18f8e-cb7c-425f-ac06-b208be847014'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:01.494761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] The token cache is being invalidate because project 20376bc2dfc04833983c3e6884ce5b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:57:01.495613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:01.496113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2ab18f8e-cb7c-425f-ac06-b208be847014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:01.498757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1125/2248] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:57:01 2022] DELETE /identity/v3/projects/20376bc2dfc04833983c3e6884ce5b33 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:10.544629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:11.491459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:12.181390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f00f-8b45-4d28-bfae-859fe6394ea0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:12.181965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f00f-8b45-4d28-bfae-859fe6394ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:12.181965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f00f-8b45-4d28-bfae-859fe6394ea0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:12.185326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1124/2249] 10.222.0.75 () {54 vars in 961 bytes} [Wed Aug 31 10:57:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:12.192615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f3a4-fc3d-46db-a7dd-832ed773277c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:12.193186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f3a4-fc3d-46db-a7dd-832ed773277c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:12.193869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f3a4-fc3d-46db-a7dd-832ed773277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:12.226659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-03b7f3a4-fc3d-46db-a7dd-832ed773277c None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:12.227977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-03b7f3a4-fc3d-46db-a7dd-832ed773277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:12.316062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1126/2250] 10.222.0.75 () {58 vars in 1058 bytes} [Wed Aug 31 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:12.323816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0f00f-8b45-4d28-bfae-859fe6394ea0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:12.337810 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0f00f-8b45-4d28-bfae-859fe6394ea0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:12.343681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:12.344305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:12.344585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:12.344852 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:12.346713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:12.360099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:12.362016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:12.372930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1125/2251] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:13.066193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0130c-c7de-4765-9070-a33a3df0df26 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:13.066869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0130c-c7de-4765-9070-a33a3df0df26 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:13.067159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0130c-c7de-4765-9070-a33a3df0df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:13.087028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-aeb0130c-c7de-4765-9070-a33a3df0df26 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:13.088300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aeb0130c-c7de-4765-9070-a33a3df0df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:13.144867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1127/2252] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:57:13.157794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:13.159653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:13.242732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2202d0-507b-4313-b618-3e056d45b7f2 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:13.251255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:13.252202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:13.252640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:13.252922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:13.262414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:13.264178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:13.272886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1126/2253] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:13.828256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc083-df1d-4f27-a671-55a21fe7a04a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:13.828546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc083-df1d-4f27-a671-55a21fe7a04a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:13.828823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc083-df1d-4f27-a671-55a21fe7a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:13.848488 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-468fc083-df1d-4f27-a671-55a21fe7a04a None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:13.849686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-468fc083-df1d-4f27-a671-55a21fe7a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:13.857110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1128/2254] 10.222.0.75 () {58 vars in 967 bytes} [Wed Aug 31 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:13.869868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:13.880985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0679-fbe1-4f10-bca5-53bdb4facb65 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:13.886169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:13.886783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:13.887054 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:13.887318 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:13.895917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:13.897476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:13.906664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1127/2255] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:14.146374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb04a5-2028-476c-82eb-3b83b886f283 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:14.146859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb04a5-2028-476c-82eb-3b83b886f283 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:14.146971 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb04a5-2028-476c-82eb-3b83b886f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:14.166108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-50fb04a5-2028-476c-82eb-3b83b886f283 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:14.167309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-50fb04a5-2028-476c-82eb-3b83b886f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:14.175922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1129/2256] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:57:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:14.203851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:14.217891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0596fd-7088-4cbb-8835-a50135a61e24 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:14.223998 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:14.224594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:14.224908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:14.225170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:14.233183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:14.234945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:14.242765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1128/2257] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:14.578418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:14.578707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:14.578984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:14.599554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:14.600675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:14.608139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1130/2258] 10.222.0.75 () {58 vars in 967 bytes} [Wed Aug 31 10:57:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:14.621063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:14.639666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b386-5a46-495f-a6b1-df87aeb07aad service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:14.649160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ed4f-a83b-4c17-aac6-df6c18a026a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:14.650356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ed4f-a83b-4c17-aac6-df6c18a026a6 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:14.650552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ed4f-a83b-4c17-aac6-df6c18a026a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:14.650904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ed4f-a83b-4c17-aac6-df6c18a026a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:14.662596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1ed4f-a83b-4c17-aac6-df6c18a026a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:14.664722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1ed4f-a83b-4c17-aac6-df6c18a026a6 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:14.674530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1129/2259] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:16.914858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:16.916413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:16.996945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89646aa4-3ea7-4785-8c10-a3e95163850e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.002503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.003441 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.003623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.004018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] PATH_INFO: `/v3/users/9ca28332a4944d5a8d64085e4148b649` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.005308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca28332a4944d5a8d64085e4148b649)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.009465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.032355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:17.058396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca28332a4944d5a8d64085e4148b649'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.059069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca28332a4944d5a8d64085e4148b649'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.067586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca28332a4944d5a8d64085e4148b649'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.068204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca28332a4944d5a8d64085e4148b649'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.081269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca28332a4944d5a8d64085e4148b649'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.093869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1131/2260] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:57:16 2022] DELETE /identity/v3/users/9ca28332a4944d5a8d64085e4148b649 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:17.098945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.099431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.099524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.118982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:17.120206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:17.178018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1130/2261] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:17.188255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.189789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:17.251815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7974a-5e91-4de5-ba1b-c339ae4f3168 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.257404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89544396-2b12-42d5-8d57-33bcbbbe8828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.258071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89544396-2b12-42d5-8d57-33bcbbbe8828 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.258351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89544396-2b12-42d5-8d57-33bcbbbe8828 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.258605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89544396-2b12-42d5-8d57-33bcbbbe8828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.269001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89544396-2b12-42d5-8d57-33bcbbbe8828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.270532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89544396-2b12-42d5-8d57-33bcbbbe8828 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.280254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1132/2262] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:57:17.474326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.475809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:17.488444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f96c-687f-4313-9fb4-d0f78083e6cf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.493064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.493712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.494029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.494299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] PATH_INFO: `/v3/projects/dec1e95f67cb4ec48c5741475828db91` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.495434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec1e95f67cb4ec48c5741475828db91)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.497515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.538194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:17.551051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec1e95f67cb4ec48c5741475828db91', 'request_id': 'req-9738235e-ebc0-4264-8cf0-cc83bc73abc6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.557214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec1e95f67cb4ec48c5741475828db91', 'request_id': 'req-9738235e-ebc0-4264-8cf0-cc83bc73abc6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.567507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec1e95f67cb4ec48c5741475828db91', 'request_id': 'req-9738235e-ebc0-4264-8cf0-cc83bc73abc6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.579015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] The token cache is being invalidate because project dec1e95f67cb4ec48c5741475828db91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:57:17.579227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.579905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9738235e-ebc0-4264-8cf0-cc83bc73abc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:17.581671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1131/2263] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:57:17 2022] DELETE /identity/v3/projects/dec1e95f67cb4ec48c5741475828db91 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:17.586466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.586824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.587126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.607974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:17.609215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:17.672250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1133/2264] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:17.682790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.684045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.684045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.704641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:17.705994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:17.719044 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1132/2265] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:17.723219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.733262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663592-4b51-43bc-8a71-ef6abde0a183 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.738725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.739768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.739768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.739965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.740530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:17.740831 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.742533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.755559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1134/2266] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:17.760361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.770052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab8b0-94fa-45a4-9ff5-0727c08f9bac None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.774653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.775288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.775561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.775828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.776506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.778491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.806673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1133/2267] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:57:17 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:57:17.811272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.821386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e679371-8e46-4106-86ca-14fe7335940c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.856345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:17.886769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.887558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.887904 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.888308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.889085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.891154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.914396 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1135/2268] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:57:17 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:57:17.918752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.929282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaac2c-ebb2-402b-b7f3-1d204a6573da admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.934328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.934940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.935218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.935496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.936186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.937859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.949826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1134/2269] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:57:17.952297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:17.962731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92370fe5-8f19-4bce-8c35-873c68890741 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:17.967439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170619c5-729a-400e-89d2-731801891c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:17.968058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170619c5-729a-400e-89d2-731801891c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:17.968332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170619c5-729a-400e-89d2-731801891c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:17.968602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170619c5-729a-400e-89d2-731801891c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:17.969416 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170619c5-729a-400e-89d2-731801891c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:17.971083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170619c5-729a-400e-89d2-731801891c28 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:17.987210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1136/2270] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:57:17.988579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:18.001349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ddc1-4e3b-44d6-a98a-b4e10d279bd9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:18.006793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:18.007459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:18.007736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:18.008731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] PATH_INFO: `/v3/projects/54f6126a98384bd189b960708bb4376e/users/d64a3d12f7ae4c8982bdc54b5853b169/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:18.029401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f6126a98384bd189b960708bb4376e, user_id=d64a3d12f7ae4c8982bdc54b5853b169, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:18.032189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:18.053511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1135/2271] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:57:17 2022] PUT /identity/v3/projects/54f6126a98384bd189b960708bb4376e/users/d64a3d12f7ae4c8982bdc54b5853b169/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:18.059485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:18.059771 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:18.060043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:18.079667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:18.080917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:18.141049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1137/2272] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:18.153339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:18.155282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:18.215048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563759a-e2ac-414f-afc1-be3891eefcac admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:18.219135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99dae1-5e45-40ce-b304-2626b4e73e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:18.219740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99dae1-5e45-40ce-b304-2626b4e73e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:18.220009 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99dae1-5e45-40ce-b304-2626b4e73e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:18.220272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99dae1-5e45-40ce-b304-2626b4e73e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:18.230028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99dae1-5e45-40ce-b304-2626b4e73e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:18.231523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99dae1-5e45-40ce-b304-2626b4e73e4b service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:18.241173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1136/2273] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:20.450110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:20.461731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193985c-a191-4749-93e5-a8d92d8dc2a4 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:20.466027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:20.466664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:20.466939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:20.467204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:20.469187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:20.547001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:20.548637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:20.558736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1138/2274] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:25.732875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:25.733479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:25.733479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:25.779309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] MFA Rules not processed for user `d64a3d12f7ae4c8982bdc54b5853b169`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:25.781219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:25.851756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:25.874408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1137/2275] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:25.879652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:25.896699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed0167-1c6f-438e-b41f-71aa838fc7d5 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:25.906163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:25.908519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:25.908890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:25.909995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:25.910745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:25.918067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:25.976022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1139/2276] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:57:25 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:25.979874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:25.997686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059eed8-70b1-4d85-97a7-b2a5209d4d2f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:26.163367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:26.164294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:26.166988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:26.167414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:26.168968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:26.174993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:26.225714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1138/2277] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:57:25 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:26.228272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:26.244427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a312543-d02a-489a-920e-9c45d98db0d4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:26.257465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:26.260646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:26.262102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:26.263876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:26.264849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:26.272860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:26.302348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1140/2278] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:57:26.306771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:26.324774 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9d541-967f-4fd1-bb00-00c61c78f47b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:26.334331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:26.335460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:26.335960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:26.336322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] PATH_INFO: `/v3/projects/32355a96aa6d44b585a1ab620f6c6463/users/7d369d2005144106bd33ca997c4b5324/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:26.366090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32355a96aa6d44b585a1ab620f6c6463, user_id=7d369d2005144106bd33ca997c4b5324, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:26.368792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:26.388793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1139/2279] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:57:26 2022] PUT /identity/v3/projects/32355a96aa6d44b585a1ab620f6c6463/users/7d369d2005144106bd33ca997c4b5324/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:26.392806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:26.407656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2ad5-8a99-44a3-b01c-23b0567c5aec admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:26.420512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:26.510391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b906b8-b909-4de7-87bb-49138219f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:26.511448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b906b8-b909-4de7-87bb-49138219f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:26.512037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b906b8-b909-4de7-87bb-49138219f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:26.512515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b906b8-b909-4de7-87bb-49138219f6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:26.513354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b906b8-b909-4de7-87bb-49138219f6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:26.515603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b906b8-b909-4de7-87bb-49138219f6d2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:26.530739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1141/2280] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:57:26.536650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:26.547172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42963-d592-40b7-b88b-5370fe99cae5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:26.552194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:26.553233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:26.553233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:26.553415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] PATH_INFO: `/v3/projects/32355a96aa6d44b585a1ab620f6c6463/users/7d369d2005144106bd33ca997c4b5324/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:26.556149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32355a96aa6d44b585a1ab620f6c6463, user_id=7d369d2005144106bd33ca997c4b5324, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:26.560263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:26.579152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1140/2281] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:57:26 2022] PUT /identity/v3/projects/32355a96aa6d44b585a1ab620f6c6463/users/7d369d2005144106bd33ca997c4b5324/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:32.168080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4de70-5399-42e1-8204-4bb13381e9cd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:32.168579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4de70-5399-42e1-8204-4bb13381e9cd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:32.168579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4de70-5399-42e1-8204-4bb13381e9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:32.212592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c1a4de70-5399-42e1-8204-4bb13381e9cd None None] MFA Rules not processed for user `7d369d2005144106bd33ca997c4b5324`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:32.214161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c1a4de70-5399-42e1-8204-4bb13381e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:32.301806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1142/2282] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:32.319762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:32.323967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:32.434636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605502-c6d2-4010-82d7-d39d7a9c8e2d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:32.442733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:32.443688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:32.443967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:32.444240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:32.457401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598df609-5aa5-48ba-a090-6605af92c234 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:32.457968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598df609-5aa5-48ba-a090-6605af92c234 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:32.458419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598df609-5aa5-48ba-a090-6605af92c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:32.481751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-598df609-5aa5-48ba-a090-6605af92c234 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:32.483565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-598df609-5aa5-48ba-a090-6605af92c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:32.488301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:32.509953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:32.512053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:32.536802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1141/2283] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:32.568217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1143/2284] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:32.580858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:32.582836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:32.661202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e2b4e-f6c5-48a5-85d2-4471ae89bd12 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:32.668120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4e81-f16b-4c90-97a4-a7efa253afec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:32.668908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4e81-f16b-4c90-97a4-a7efa253afec service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:32.669185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4e81-f16b-4c90-97a4-a7efa253afec service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:32.669460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4e81-f16b-4c90-97a4-a7efa253afec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:32.680170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4e81-f16b-4c90-97a4-a7efa253afec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:32.682441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4e81-f16b-4c90-97a4-a7efa253afec service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:32.695771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1142/2285] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:34.006085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed96b1-b859-473d-be2a-ed09077b179f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:34.007100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed96b1-b859-473d-be2a-ed09077b179f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:34.007589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed96b1-b859-473d-be2a-ed09077b179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:34.037081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-22ed96b1-b859-473d-be2a-ed09077b179f None None] MFA Rules not processed for user `d64a3d12f7ae4c8982bdc54b5853b169`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:34.038754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-22ed96b1-b859-473d-be2a-ed09077b179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:34.054373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1144/2286] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:42.689067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=42 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:44.029178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=86 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:47.931088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04b88-e2f6-41d1-bae3-6810d4726a82 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:47.931832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04b88-e2f6-41d1-bae3-6810d4726a82 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:47.931832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04b88-e2f6-41d1-bae3-6810d4726a82 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:47.933951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1143/2287] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:47.942378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917e6c-69a0-4791-87ca-404590b57a39 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:47.942931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917e6c-69a0-4791-87ca-404590b57a39 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:47.942931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917e6c-69a0-4791-87ca-404590b57a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:47.964900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4f917e6c-69a0-4791-87ca-404590b57a39 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:47.967360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4f917e6c-69a0-4791-87ca-404590b57a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:47.986975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1145/2288] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:57:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:47.994455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04b88-e2f6-41d1-bae3-6810d4726a82 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:47.996295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b5b04b88-e2f6-41d1-bae3-6810d4726a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.062899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04b88-e2f6-41d1-bae3-6810d4726a82 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.066523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279143b-f961-4d2c-8f0b-ca80d3cb6f97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:48.067134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279143b-f961-4d2c-8f0b-ca80d3cb6f97 service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.067428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279143b-f961-4d2c-8f0b-ca80d3cb6f97 service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.067694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279143b-f961-4d2c-8f0b-ca80d3cb6f97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.077582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279143b-f961-4d2c-8f0b-ca80d3cb6f97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:48.079032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279143b-f961-4d2c-8f0b-ca80d3cb6f97 service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:48.090415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1144/2289] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:57:48.162330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c8470-cce2-4f9e-891c-e5ec8474c6cd None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.162758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c8470-cce2-4f9e-891c-e5ec8474c6cd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.163040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c8470-cce2-4f9e-891c-e5ec8474c6cd None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.164426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1146/2290] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:48.169237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd5b2-0a06-4403-941f-fc30a3a4cf01 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.169513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd5b2-0a06-4403-941f-fc30a3a4cf01 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.169798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd5b2-0a06-4403-941f-fc30a3a4cf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.190893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-559cd5b2-0a06-4403-941f-fc30a3a4cf01 None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:48.192077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-559cd5b2-0a06-4403-941f-fc30a3a4cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.245091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1145/2291] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:57:48.257500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c8470-cce2-4f9e-891c-e5ec8474c6cd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:48.259673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d46c8470-cce2-4f9e-891c-e5ec8474c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.274847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c8470-cce2-4f9e-891c-e5ec8474c6cd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.278885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6815c-905a-4e61-a9dd-422aa30c584a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:48.279486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6815c-905a-4e61-a9dd-422aa30c584a service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.279769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6815c-905a-4e61-a9dd-422aa30c584a service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.280032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6815c-905a-4e61-a9dd-422aa30c584a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.287844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6815c-905a-4e61-a9dd-422aa30c584a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:48.289398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6815c-905a-4e61-a9dd-422aa30c584a service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:48.297943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1147/2292] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:48.391734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edfd0-42f2-49a6-9220-413dd584431e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.392016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edfd0-42f2-49a6-9220-413dd584431e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.392291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edfd0-42f2-49a6-9220-413dd584431e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.393675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1146/2293] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:48.401235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3afc0-2375-4592-aa1e-0df7162389d8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.401516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3afc0-2375-4592-aa1e-0df7162389d8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.401798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3afc0-2375-4592-aa1e-0df7162389d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.422911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-04e3afc0-2375-4592-aa1e-0df7162389d8 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:48.424171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-04e3afc0-2375-4592-aa1e-0df7162389d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.436448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1148/2294] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:48.447664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edfd0-42f2-49a6-9220-413dd584431e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:48.460031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edfd0-42f2-49a6-9220-413dd584431e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.463838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:48.464444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.464715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.464985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.476261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:48.478127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:48.489933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1147/2295] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:52.146642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7173f-fd19-4005-92a6-d9907488f17f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:52.147145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7173f-fd19-4005-92a6-d9907488f17f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:52.147145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7173f-fd19-4005-92a6-d9907488f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:52.167450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-61e7173f-fd19-4005-92a6-d9907488f17f None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:52.168651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-61e7173f-fd19-4005-92a6-d9907488f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:52.177230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1149/2296] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:52.189828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:52.201858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a5df4-8995-4e58-afe0-dc2e2a1e34e7 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:52.207693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:52.208290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:52.208587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:52.208830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:52.217223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:52.218845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:52.227545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1148/2297] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:02.161581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=15 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:02.223741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=61 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:21.951655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3539b-3975-4607-8575-6df2dbf303c9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:21.952241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3539b-3975-4607-8575-6df2dbf303c9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:21.952241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3539b-3975-4607-8575-6df2dbf303c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:21.971948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e1a3539b-3975-4607-8575-6df2dbf303c9 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:21.973302 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e1a3539b-3975-4607-8575-6df2dbf303c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:21.980646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1150/2298] 10.222.0.75 () {58 vars in 967 bytes} [Wed Aug 31 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:22.006721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:22.018004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42baab-3e0b-4557-af88-235fdf618477 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:22.024679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:22.025289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.025557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.025966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.035431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:22.037027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:22.046195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1149/2299] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:58:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:31.966761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:32.042609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.876409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42d27-ca19-40ad-a95e-422cd0df04b4 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.877296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42d27-ca19-40ad-a95e-422cd0df04b4 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.877749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42d27-ca19-40ad-a95e-422cd0df04b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.920940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-38f42d27-ca19-40ad-a95e-422cd0df04b4 None None] MFA Rules not processed for user `9cf2f9dbdcfe4cce91fd4c03cd8e8bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:40.922207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-38f42d27-ca19-40ad-a95e-422cd0df04b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:40.983086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1151/2300] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:58:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:42.407101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.416863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760f25-e940-469d-89f1-a1c6ef6f1a89 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:42.421030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.421644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.421952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.422221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.432771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.434867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.446544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1150/2301] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:45.351361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.351951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.352341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.377155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] MFA Rules not processed for user `73f1b9e32ad3493284c5df45afd042fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:45.378683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:45.473276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1152/2302] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:52.441325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.459745 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=50 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.926524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.935962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96da2a4-5d07-4eb3-9973-4e97d003cb35 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.940640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.941233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.941487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.941799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.943876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:05.959443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.960868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.972398 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1151/2303] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:07.424760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.436746 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a860faa-97a2-4c57-84a0-1ebf14df14d5 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.441758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.442408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.442683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.442953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.445001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:07.459239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.460678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc052085-d9a3-4a15-b4fa-a6dfcbf6c708 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.472057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1153/2304] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:15.967056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.466720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.273296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.291964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb19b1-fc88-46d1-ad87-b79edd491fde service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.297488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.298139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.298411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.298680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.300429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:18.362237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.363827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96653ccf-1b1b-4aa0-9033-e19f0a310de6 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.372996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1152/2305] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:25.743342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.743950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.744099 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.764055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] MFA Rules not processed for user `3dc4ac4ada004bbb942c36755f4a7cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:25.765166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.772997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1154/2306] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:28.320064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.320616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.320616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.341368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] MFA Rules not processed for user `324325d907f244beb6862df4116f2c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:28.342606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:28.398233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1153/2307] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:28.766772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.777066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959a4ed-41de-43e8-b8d3-7a7567d3663c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.781032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.781735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.781981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.785808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.785808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:28.794081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.795572 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.803776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1155/2308] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:29.392118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.393587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:29.465729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e2c8-2514-41a9-8d38-e4e1443a8aa7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.470901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.471516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.471790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.472056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.474380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:29.485999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.487628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.500747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1154/2309] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:31.372639 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.374625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.432801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a885f-dd3b-4d52-b112-76bb745b50a5 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.438439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.439144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.439426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.439700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.441468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.505554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.507215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.516809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1156/2310] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:34.528158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.538394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2ecc-872a-4249-b318-ea150e6a73a7 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.541799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.542404 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.542678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.542945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.544812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.555583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.557030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b5f7-94e2-434e-a3e3-d481b2fc9e1c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.566017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1155/2311] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:37.621566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.651260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f5e1-0a91-4f01-a371-44dedbf8568e service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.658778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.659414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.659824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.659951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.662040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:37.676799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.678864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.694100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1157/2312] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:43.735287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d1d4-f3db-4de3-8d7a-3ecc33e0a384 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.735836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d1d4-f3db-4de3-8d7a-3ecc33e0a384 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.735836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d1d4-f3db-4de3-8d7a-3ecc33e0a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.754869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dc40d1d4-f3db-4de3-8d7a-3ecc33e0a384 None None] MFA Rules not processed for user `cbb16c0b86444a59ab299013c694cb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:43.756126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dc40d1d4-f3db-4de3-8d7a-3ecc33e0a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:43.763068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1156/2313] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:47.689076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=63 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:50.601760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:50.614139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55e8c2-0b68-4244-990c-a9a5b3451165 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:50.620690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:50.621427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.621695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.622150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.624026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:50.642637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:50.644502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683087-ab32-4fbe-9c85-aa0bfdd287a0 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:50.656211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1158/2314] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:50.894722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d1189-eaff-46a4-ae43-c453e513208a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.895256 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d1189-eaff-46a4-ae43-c453e513208a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.895365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d1189-eaff-46a4-ae43-c453e513208a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.896939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1157/2315] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 10:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:50.911483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.911765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.912387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.938767 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] MFA Rules not processed for user `e5e980354e45478d8e78e510db208215`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:50.940668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:50.986678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1159/2316] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 10:59:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:51.032455 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d1189-eaff-46a4-ae43-c453e513208a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.040360 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:51.048113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d1189-eaff-46a4-ae43-c453e513208a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.054032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.054860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.055337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.055900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.070120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.071731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.082776 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1158/2317] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:51.153231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.155052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.232736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc60c-8251-4e8c-bd36-79daeaed1ac6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.249630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.250575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.250575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.250860 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] PATH_INFO: `/v3/users/9cf2f9dbdcfe4cce91fd4c03cd8e8bba` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.252065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf2f9dbdcfe4cce91fd4c03cd8e8bba)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.254087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.310673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.311326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.319690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.320467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.332705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e90fef56-f7dd-4b1c-bf5a-f08021d846d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.345356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1160/2318] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:51 2022] DELETE /identity/v3/users/9cf2f9dbdcfe4cce91fd4c03cd8e8bba => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:51.526160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.538599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e6d4-ec0a-4da7-8bc6-8cc3aeade2b2 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.599758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.600551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.600823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.601148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] PATH_INFO: `/v3/projects/4ff7c6e80bed43ecbcf17e4fa1bad450` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.602302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff7c6e80bed43ecbcf17e4fa1bad450)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.604204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.651552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'request_id': 'req-a439727b-12ca-4046-9a39-eac07fe8ac17'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.658017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'request_id': 'req-a439727b-12ca-4046-9a39-eac07fe8ac17'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.669548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'request_id': 'req-a439727b-12ca-4046-9a39-eac07fe8ac17'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.681087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] The token cache is being invalidate because project 4ff7c6e80bed43ecbcf17e4fa1bad450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:51.681377 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.682079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a439727b-12ca-4046-9a39-eac07fe8ac17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.683574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1159/2319] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:51 2022] DELETE /identity/v3/projects/4ff7c6e80bed43ecbcf17e4fa1bad450 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:51.688849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.689318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.689415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.711280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:51.712491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.764350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:51.773851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1161/2320] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:51.781839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.782125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.782399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.802613 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:51.803804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.813115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1160/2321] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:51.817228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.827145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a618f-cafa-4827-8e37-3cd618646d44 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.832415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.833111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.833385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.833652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.834323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:51.834619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.836260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.848850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1162/2322] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:51.852832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.862379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b387-e914-4573-81b5-3c9255857e08 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.868223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.868794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.869064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.869329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.869990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.871891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.900689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1161/2323] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:51.904952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.915419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ee3b1-d4e6-4737-89ce-9e1e1af21000 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.974621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.975395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.975964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.976137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.976790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.978883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.004435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1163/2324] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:52.006301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.018236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fc0da-db42-4215-a1d9-5622473696f8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.023654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.024349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.024621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.024887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.025548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.027208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.038100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1162/2325] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:52.041695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.052245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c419a48-373c-4f67-8152-98a9db211a0a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.057394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6054a0-b449-4472-bad2-b0417c582933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.058115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6054a0-b449-4472-bad2-b0417c582933 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.058455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6054a0-b449-4472-bad2-b0417c582933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.058786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6054a0-b449-4472-bad2-b0417c582933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.059791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6054a0-b449-4472-bad2-b0417c582933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.061454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6054a0-b449-4472-bad2-b0417c582933 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.075246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1164/2326] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:52.079269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.090148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e963e-0dd4-4109-8358-052d54df8c37 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.095781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.096441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.096749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.097015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] PATH_INFO: `/v3/projects/3bcd91e3a6e2465ebe4fa613d9cc1382/users/f229281b11e54b35bc7992dad67ada58/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.113477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bcd91e3a6e2465ebe4fa613d9cc1382, user_id=f229281b11e54b35bc7992dad67ada58, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.116180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.130781 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1163/2327] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:52 2022] PUT /identity/v3/projects/3bcd91e3a6e2465ebe4fa613d9cc1382/users/f229281b11e54b35bc7992dad67ada58/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:52.200358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.200645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.200919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.230214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] MFA Rules not processed for user `f229281b11e54b35bc7992dad67ada58`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:52.231399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.299816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1165/2328] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:52.314786 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.316593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.335944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.380944 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661aeb5-6c79-4f49-8ceb-f7313bc55080 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.384885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27ac88-2788-4b30-bcbc-405024d48146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.385537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27ac88-2788-4b30-bcbc-405024d48146 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.385837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27ac88-2788-4b30-bcbc-405024d48146 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.386106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27ac88-2788-4b30-bcbc-405024d48146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.395758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27ac88-2788-4b30-bcbc-405024d48146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.397277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27ac88-2788-4b30-bcbc-405024d48146 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.406967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1164/2329] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:54.184323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.186717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:54.270095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:54.298215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17195c-7441-428a-9a8f-2042b2f83bc0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.307344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.309265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.310519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.310856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.313722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:54.330192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.331940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.343573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1166/2330] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:59.756199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.756782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.756782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.777010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:59.778258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:59.843773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1165/2331] 10.222.0.75 () {58 vars in 967 bytes} [Wed Aug 31 10:59:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:59.893467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:59.895244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:59.973017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5aede-8613-4b93-b52b-7f1a12646ee4 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.978509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.979800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.979800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.979800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.988547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.990227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.998717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1167/2332] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 10:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:00:00.156397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:00.157859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:00.174408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c5ca-fc22-4949-b6db-2248273789d1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:00.184178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:00.185276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.185616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:00.185981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:00.188021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:00.256214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:00.257977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd790f-3f06-4ba2-b14a-e5dbd6fe030c service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:00.268172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1166/2333] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:00.598271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:00.689919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfe9f6-c46a-420f-a865-95cacd7ae4e9 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:00.694527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:00.695171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.696658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:00.696658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] PATH_INFO: `/v3/users/f229281b11e54b35bc7992dad67ada58` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:00.697149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f229281b11e54b35bc7992dad67ada58)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:00.699442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:00.755838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f229281b11e54b35bc7992dad67ada58'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:00.756593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f229281b11e54b35bc7992dad67ada58'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:00.771599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f229281b11e54b35bc7992dad67ada58'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:00.772227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f229281b11e54b35bc7992dad67ada58'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:00.787344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f229281b11e54b35bc7992dad67ada58'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:00.788700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:00.805672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1168/2334] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:00 2022] DELETE /identity/v3/users/f229281b11e54b35bc7992dad67ada58 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:00.810824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.811866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:00.812293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:00.838948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:00.840541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:00.923705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1167/2335] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:00.943101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:00.945265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:01.014093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20459-0ef0-4346-aef3-b79004235c87 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:01.017671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:01.020430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.020714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.020984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.031238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:01.032758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:01.044257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1169/2336] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:01.746705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.748133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:01.755351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:01.761709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2183f-8d34-43b2-9bca-1c2d67126597 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:01.767473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:01.768834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.769107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.769839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] PATH_INFO: `/v3/projects/3bcd91e3a6e2465ebe4fa613d9cc1382` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.770575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bcd91e3a6e2465ebe4fa613d9cc1382)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:01.772506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:01.911222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bcd91e3a6e2465ebe4fa613d9cc1382', 'request_id': 'req-e91f5f28-77f6-4028-86ec-0f5da591fd17'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:01.935451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bcd91e3a6e2465ebe4fa613d9cc1382', 'request_id': 'req-e91f5f28-77f6-4028-86ec-0f5da591fd17'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:01.955945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bcd91e3a6e2465ebe4fa613d9cc1382', 'request_id': 'req-e91f5f28-77f6-4028-86ec-0f5da591fd17'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:01.992569 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] The token cache is being invalidate because project 3bcd91e3a6e2465ebe4fa613d9cc1382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:01.992892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:01.994955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:02.009890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1168/2337] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:01 2022] DELETE /identity/v3/projects/3bcd91e3a6e2465ebe4fa613d9cc1382 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:07.917791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.919358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:07.976270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.977747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.010711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38787-ea01-4119-b0dd-1902c98ec592 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.069409 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f5f28-77f6-4028-86ec-0f5da591fd17 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.074992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.075160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.075782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.075923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.076182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.076285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.076563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.076666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] PATH_INFO: `/v3/users/1847928c4aa04730a897f38ac67d7071` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.077968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1847928c4aa04730a897f38ac67d7071)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.078736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.080030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.091413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.092567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.102842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1170/2338] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:08.138140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1847928c4aa04730a897f38ac67d7071'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.148625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1847928c4aa04730a897f38ac67d7071'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.149240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1847928c4aa04730a897f38ac67d7071'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.162081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1847928c4aa04730a897f38ac67d7071'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.162791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1847928c4aa04730a897f38ac67d7071'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.175158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1169/2339] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:07 2022] DELETE /identity/v3/users/1847928c4aa04730a897f38ac67d7071 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:08.358525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.369992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ebb2-ae68-4dbb-b2a8-560c9ab3f260 service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.394473 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.436996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.437635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.437951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.438223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] PATH_INFO: `/v3/projects/6edee50c9ca84b43b58209073abb6642` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.439366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edee50c9ca84b43b58209073abb6642)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.441341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.495425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edee50c9ca84b43b58209073abb6642', 'request_id': 'req-09649860-f1d9-44f6-b4ed-910d8e09b2cf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.501724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edee50c9ca84b43b58209073abb6642', 'request_id': 'req-09649860-f1d9-44f6-b4ed-910d8e09b2cf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.512464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edee50c9ca84b43b58209073abb6642', 'request_id': 'req-09649860-f1d9-44f6-b4ed-910d8e09b2cf'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.524087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] The token cache is being invalidate because project 6edee50c9ca84b43b58209073abb6642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:08.524372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.525084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.527037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1171/2340] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:08 2022] DELETE /identity/v3/projects/6edee50c9ca84b43b58209073abb6642 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:08.531266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.532832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.545274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.547310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981bb98-4841-4cb5-8f6e-18db15a4f355 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.608579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.609130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.609422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.609680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] PATH_INFO: `/v3/users/fecf60d3fd6a4fd3b131e304ba0820e3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.610855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fecf60d3fd6a4fd3b131e304ba0820e3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.612744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.671579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fecf60d3fd6a4fd3b131e304ba0820e3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.680364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fecf60d3fd6a4fd3b131e304ba0820e3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.681039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fecf60d3fd6a4fd3b131e304ba0820e3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.693995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fecf60d3fd6a4fd3b131e304ba0820e3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.694656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-42aeb55b-413d-4a42-83ee-b624be24c805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fecf60d3fd6a4fd3b131e304ba0820e3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.706649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1170/2341] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:08 2022] DELETE /identity/v3/users/fecf60d3fd6a4fd3b131e304ba0820e3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:08.895385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.897373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.914210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09649860-f1d9-44f6-b4ed-910d8e09b2cf admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.982446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.983148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.983352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.983621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] PATH_INFO: `/v3/projects/1b0fb1f1aa974bef8f4c0523551e6fab` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.984741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0fb1f1aa974bef8f4c0523551e6fab)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.986738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.037851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0fb1f1aa974bef8f4c0523551e6fab', 'request_id': 'req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.044185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0fb1f1aa974bef8f4c0523551e6fab', 'request_id': 'req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.047571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.054240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0fb1f1aa974bef8f4c0523551e6fab', 'request_id': 'req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.066795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] The token cache is being invalidate because project 1b0fb1f1aa974bef8f4c0523551e6fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:09.067121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.067796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.069351 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1172/2342] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:08 2022] DELETE /identity/v3/projects/1b0fb1f1aa974bef8f4c0523551e6fab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:18.296718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:18.297253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:18.297371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:18.318367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] MFA Rules not processed for user `73f1b9e32ad3493284c5df45afd042fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:18.319584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:18.389100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1171/2343] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:19.063797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=3,keystone:SELECT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:28.377186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=76,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:34.475946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:34.478015 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:34.541469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b6f6-6084-4a8b-9e33-ffaebedc0ff7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:34.545009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:34.545659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:34.545964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:34.546235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:34.547974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:34.617344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:34.619370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:34.630115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1173/2344] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:37.532840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:37.534473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:37.644658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7490-d6a4-48ff-9ccb-3780ba744c86 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:37.651159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:37.651942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:37.652753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:37.653136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:37.655058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:37.732005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:37.733918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:37.744271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1172/2345] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:38.165811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:38.167283 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:38.179607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e720b-585e-4ece-9e7d-d0259b558177 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:38.184279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:38.184828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.185224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.185896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] PATH_INFO: `/v3/users/3dc4ac4ada004bbb942c36755f4a7cd1` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.187011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc4ac4ada004bbb942c36755f4a7cd1)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:38.189135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:38.236841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc4ac4ada004bbb942c36755f4a7cd1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.237479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc4ac4ada004bbb942c36755f4a7cd1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.246364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc4ac4ada004bbb942c36755f4a7cd1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.246973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc4ac4ada004bbb942c36755f4a7cd1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.259130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c5dd83d-b9a0-477e-932a-91b832133f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc4ac4ada004bbb942c36755f4a7cd1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.271535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1174/2346] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:38 2022] DELETE /identity/v3/users/3dc4ac4ada004bbb942c36755f4a7cd1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:38.452914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:38.464379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a26d8-2d2e-416d-aea0-234216e34700 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:38.524340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:38.524961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.525261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.525547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] PATH_INFO: `/v3/projects/3aabb02cf14541f997b08fe0853acac0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.526752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aabb02cf14541f997b08fe0853acac0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:38.528717 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:38.570038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:38.577763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aabb02cf14541f997b08fe0853acac0', 'request_id': 'req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.587219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aabb02cf14541f997b08fe0853acac0', 'request_id': 'req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.595894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aabb02cf14541f997b08fe0853acac0', 'request_id': 'req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.608296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] The token cache is being invalidate because project 3aabb02cf14541f997b08fe0853acac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:38.608587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.609298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5233dc1f-18ae-4a12-b7e0-8a9afb5c37eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:38.611038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1173/2347] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:38 2022] DELETE /identity/v3/projects/3aabb02cf14541f997b08fe0853acac0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:38.617009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169bc1-f960-4f72-898d-07b407126358 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.617321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169bc1-f960-4f72-898d-07b407126358 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.617714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169bc1-f960-4f72-898d-07b407126358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.646379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-82169bc1-f960-4f72-898d-07b407126358 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:38.647539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-82169bc1-f960-4f72-898d-07b407126358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:38.665565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:38.710623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1175/2348] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:00:38.718690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1068d-a322-4139-9927-290778aafc24 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.718997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1068d-a322-4139-9927-290778aafc24 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.719259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1068d-a322-4139-9927-290778aafc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.739949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-78f1068d-a322-4139-9927-290778aafc24 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:38.741153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-78f1068d-a322-4139-9927-290778aafc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:38.749841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1174/2349] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:38.754502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169bc1-f960-4f72-898d-07b407126358 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:38.764908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169bc1-f960-4f72-898d-07b407126358 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:38.770668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:38.771285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.771563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.771829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.772472 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:38.772770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:38.774445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:38.787275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1176/2350] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:38.791632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1068d-a322-4139-9927-290778aafc24 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:38.801126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1068d-a322-4139-9927-290778aafc24 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:38.805994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:38.806584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.806855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.807119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.807739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:38.809634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:38.844027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1175/2351] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:38 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:38.848594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:38.859001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef8ac-6dd0-4cb7-b384-36d8681f8a38 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:38.922125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:38.922747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.923027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.923301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.923939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:38.925967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:38.952590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1177/2352] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:38 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:38.957004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:38.967429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dafc2a-5ec6-4cf9-940b-477ba1213a49 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:38.973611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:38.974276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:38.974546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:38.974817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:38.975463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:38.977066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:38.989030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1176/2353] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:38.993166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.005269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c46e-d789-42fc-a4da-0940d60e2561 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.010567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eff294-8fdd-450b-bd0a-4c63abb66ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.011183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eff294-8fdd-450b-bd0a-4c63abb66ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.011465 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eff294-8fdd-450b-bd0a-4c63abb66ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.011738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eff294-8fdd-450b-bd0a-4c63abb66ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.012389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eff294-8fdd-450b-bd0a-4c63abb66ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.014051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eff294-8fdd-450b-bd0a-4c63abb66ba7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.025163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1178/2354] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:39.030561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.040832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ae653-ba08-41cc-8267-a2a3b691c28f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.046556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.047259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.047533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.047804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] PATH_INFO: `/v3/projects/c5a218ad1ef24721816c4dabb96b84da/users/78db7fd021c44ab58701c01f3afccbe2/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.064838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a218ad1ef24721816c4dabb96b84da, user_id=78db7fd021c44ab58701c01f3afccbe2, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.067686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.083529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1177/2355] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:39 2022] PUT /identity/v3/projects/c5a218ad1ef24721816c4dabb96b84da/users/78db7fd021c44ab58701c01f3afccbe2/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:00:39.095293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.095579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.095850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.125812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] MFA Rules not processed for user `78db7fd021c44ab58701c01f3afccbe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:39.127041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:39.194225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1179/2356] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:00:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:39.198837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.262243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c90d-8cf4-4941-a444-c673345bb133 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.268005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.268756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.269046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.269338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.270315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.273337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.311660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1178/2357] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:39 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:39.316093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.327658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa88c33-8d31-43e3-81c2-54094f4d6cc9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.340819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:39.391084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.391708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.391986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.392319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.392959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.394967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.419889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1180/2358] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:39 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:39.427082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.439962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2230-5c8d-4acc-a750-e9d50df1c3e1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.445585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.446179 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.446476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.446748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.447563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.450265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.467487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1179/2359] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:39.473134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.484430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868dbfa-8686-43e6-bc47-a6c0bff27959 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.491011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.491780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.492123 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.492399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] PATH_INFO: `/v3/projects/b68d9b9e9cb448aeab30d7e0744a8b5d/users/b1e6fe7ab291483ea0262db6232e1dd2/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.508754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68d9b9e9cb448aeab30d7e0744a8b5d, user_id=b1e6fe7ab291483ea0262db6232e1dd2, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.511468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.527520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1181/2360] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:39 2022] PUT /identity/v3/projects/b68d9b9e9cb448aeab30d7e0744a8b5d/users/b1e6fe7ab291483ea0262db6232e1dd2/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:39.531737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.541872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703455-de8d-4316-8958-df40b8e39e75 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.576967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:39.603020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb468d0-ccfb-48a0-a4ae-8874252a2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.603616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb468d0-ccfb-48a0-a4ae-8874252a2091 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.603891 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb468d0-ccfb-48a0-a4ae-8874252a2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.604161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb468d0-ccfb-48a0-a4ae-8874252a2091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.604798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb468d0-ccfb-48a0-a4ae-8874252a2091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.606463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb468d0-ccfb-48a0-a4ae-8874252a2091 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.616229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1180/2361] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:39.620568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.631606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b2d12-be73-4310-90dc-a82477bd5dd1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.637285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.637960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.638278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.638502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] PATH_INFO: `/v3/projects/b68d9b9e9cb448aeab30d7e0744a8b5d/users/b1e6fe7ab291483ea0262db6232e1dd2/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.640660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68d9b9e9cb448aeab30d7e0744a8b5d, user_id=b1e6fe7ab291483ea0262db6232e1dd2, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.643356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.654286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1182/2362] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:39 2022] PUT /identity/v3/projects/b68d9b9e9cb448aeab30d7e0744a8b5d/users/b1e6fe7ab291483ea0262db6232e1dd2/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:39.664590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.664874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.665127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.698741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] MFA Rules not processed for user `b1e6fe7ab291483ea0262db6232e1dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:39.699880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:39.773803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1181/2363] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:00:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:39.785601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.787834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:39.850796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11219676-3b71-4485-9cab-0b11b1ca48b2 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.855160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3a5a9-e274-4771-9208-ad78f9289146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.855782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3a5a9-e274-4771-9208-ad78f9289146 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.856735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3a5a9-e274-4771-9208-ad78f9289146 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.857144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3a5a9-e274-4771-9208-ad78f9289146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.867620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3a5a9-e274-4771-9208-ad78f9289146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.869072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3a5a9-e274-4771-9208-ad78f9289146 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.878936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1183/2364] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:39.958763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.969332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c9b4f-6447-4a15-a03a-3fe56fb16570 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.973641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.974278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.974551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.974821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:40.033635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:40.035090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:40.044233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1182/2365] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:49.874586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:50.039865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=74 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:00.777613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f16c90-8a13-4517-be52-15b774bf1a36 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:00.778155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f16c90-8a13-4517-be52-15b774bf1a36 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:00.778155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f16c90-8a13-4517-be52-15b774bf1a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:00.798042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-37f16c90-8a13-4517-be52-15b774bf1a36 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:00.799372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-37f16c90-8a13-4517-be52-15b774bf1a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:00.856751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1184/2366] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:00.911443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:00.913882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:00.995790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a2a9-52c6-4977-8773-62028e5fe9c5 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:01.001396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52168948-e94f-4d71-bc9b-8fab47c92c72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:01.002066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168948-e94f-4d71-bc9b-8fab47c92c72 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:01.002346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168948-e94f-4d71-bc9b-8fab47c92c72 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:01.002612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52168948-e94f-4d71-bc9b-8fab47c92c72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:01.011584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168948-e94f-4d71-bc9b-8fab47c92c72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:01.013287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52168948-e94f-4d71-bc9b-8fab47c92c72 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:01.022162 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1183/2367] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 11:01:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:10.850118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=25 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:11.018196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=32 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:15.276402 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490ce1f-e410-45a5-b27e-df7e6caaef2b None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.276973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490ce1f-e410-45a5-b27e-df7e6caaef2b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.276973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490ce1f-e410-45a5-b27e-df7e6caaef2b None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.278900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1185/2368] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 11:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:01:15.285957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1caf-a177-42c4-8e0d-4ce9bc16a979 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.286510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1caf-a177-42c4-8e0d-4ce9bc16a979 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.286510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1caf-a177-42c4-8e0d-4ce9bc16a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.314641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b7ba1caf-a177-42c4-8e0d-4ce9bc16a979 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:15.317921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b7ba1caf-a177-42c4-8e0d-4ce9bc16a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:15.393672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1184/2369] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 11:01:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:15.406726 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490ce1f-e410-45a5-b27e-df7e6caaef2b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:15.409098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c490ce1f-e410-45a5-b27e-df7e6caaef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:15.468320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490ce1f-e410-45a5-b27e-df7e6caaef2b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:15.472275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf773672-18e3-4b86-8ddb-37d4d72073c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c86b5bf0b10480e88d5cc2d51ef1cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:15.472882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf773672-18e3-4b86-8ddb-37d4d72073c6 service glance] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.473155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf773672-18e3-4b86-8ddb-37d4d72073c6 service glance] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.473424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf773672-18e3-4b86-8ddb-37d4d72073c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.483696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf773672-18e3-4b86-8ddb-37d4d72073c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:15.485126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf773672-18e3-4b86-8ddb-37d4d72073c6 service glance] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:15.496962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1186/2370] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:15.577806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704b78-1565-4f80-9a5c-3844d9360367 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.578094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704b78-1565-4f80-9a5c-3844d9360367 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.578395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704b78-1565-4f80-9a5c-3844d9360367 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.579748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1185/2371] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 11:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:01:15.585113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a7ffc-d446-4e2b-835a-cd85e58a861d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.585405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a7ffc-d446-4e2b-835a-cd85e58a861d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.585678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a7ffc-d446-4e2b-835a-cd85e58a861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.607285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-947a7ffc-d446-4e2b-835a-cd85e58a861d None None] MFA Rules not processed for user `694756b0eedc408c8796463b541fe5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:15.608483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-947a7ffc-d446-4e2b-835a-cd85e58a861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:15.661920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1187/2372] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 11:01:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:15.673892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704b78-1565-4f80-9a5c-3844d9360367 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:15.675772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6704b78-1565-4f80-9a5c-3844d9360367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:15.689740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704b78-1565-4f80-9a5c-3844d9360367 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:15.693458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9db1a-d870-4339-a831-0a299743e0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:15.694084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9db1a-d870-4339-a831-0a299743e0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.694359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9db1a-d870-4339-a831-0a299743e0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.694626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9db1a-d870-4339-a831-0a299743e0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.701626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9db1a-d870-4339-a831-0a299743e0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:15.703073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9db1a-d870-4339-a831-0a299743e0a0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:15.710754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1186/2373] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:15.798228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384d0a-f702-4798-9313-f22939c726cb None None] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.798522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384d0a-f702-4798-9313-f22939c726cb None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.798798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384d0a-f702-4798-9313-f22939c726cb None None] PATH_INFO: `/` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.800275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1188/2374] 10.222.0.75 () {54 vars in 921 bytes} [Wed Aug 31 11:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:01:15.805805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.806121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.806395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.827711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] MFA Rules not processed for user `b4d48e600b4d470c88bd1606ea51c263`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:15.828978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:15.840586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1187/2375] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Aug 31 11:01:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:15.853452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384d0a-f702-4798-9313-f22939c726cb None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:15.855504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d7384d0a-f702-4798-9313-f22939c726cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:15.870308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384d0a-f702-4798-9313-f22939c726cb None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:15.874524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:15.875166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:15.875442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:15.875710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:15.887338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:15.888884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:15.901370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1189/2376] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:16.046922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:16.057217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71fff3-7385-4f70-8f4b-7cec5a741c69 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:16.061590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:16.062237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:16.062510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:16.062771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:16.065057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:16.145250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:16.146966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:16.159135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1188/2377] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:20.426568 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:20.428078 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:20.447789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ae969-824b-494f-bc0f-154685dc9f21 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:20.458345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:20.459414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:20.459972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:20.460479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] PATH_INFO: `/v3/users/cbb16c0b86444a59ab299013c694cb07` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:20.462109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb16c0b86444a59ab299013c694cb07)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:20.464590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:20.536587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb16c0b86444a59ab299013c694cb07'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.537193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb16c0b86444a59ab299013c694cb07'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.546234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb16c0b86444a59ab299013c694cb07'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.547538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb16c0b86444a59ab299013c694cb07'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.564951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d0b60799-221a-4ac6-915d-2da21dd3f6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb16c0b86444a59ab299013c694cb07'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.578594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1190/2378] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:20 2022] DELETE /identity/v3/users/cbb16c0b86444a59ab299013c694cb07 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:20.775896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:20.786448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da81303-88e9-4cf6-b6a5-427b6aee8667 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:20.845951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:20.846591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:20.846863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:20.847387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] PATH_INFO: `/v3/projects/dd581788f9ca4c2fb1ba3fe02f34b29d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:20.848534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd581788f9ca4c2fb1ba3fe02f34b29d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:20.850492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:20.858641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:20.899205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'request_id': 'req-85d3f642-be35-4bbf-9b58-3aaedab7dd55'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.906461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'request_id': 'req-85d3f642-be35-4bbf-9b58-3aaedab7dd55'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.915182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'request_id': 'req-85d3f642-be35-4bbf-9b58-3aaedab7dd55'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.925510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] The token cache is being invalidate because project dd581788f9ca4c2fb1ba3fe02f34b29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:20.925827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.926446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-85d3f642-be35-4bbf-9b58-3aaedab7dd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:20.927942 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1189/2379] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:20 2022] DELETE /identity/v3/projects/dd581788f9ca4c2fb1ba3fe02f34b29d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:20.935321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:20.935605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:20.935879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:20.956950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:20.958173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:20.964304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:21.019968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1191/2380] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:21.028048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87013ec-496a-4286-a470-5532f63099cd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.028335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87013ec-496a-4286-a470-5532f63099cd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.028608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87013ec-496a-4286-a470-5532f63099cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.048414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e87013ec-496a-4286-a470-5532f63099cd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:21.049664 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e87013ec-496a-4286-a470-5532f63099cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:21.058366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1190/2381] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:21.063834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.079460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997790-a133-4df8-9827-9b19b1714966 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.087387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.088298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.088747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.089198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.090301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:21.090816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.093043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.106053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1192/2382] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:21.112362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87013ec-496a-4286-a470-5532f63099cd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.122521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87013ec-496a-4286-a470-5532f63099cd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.128309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.128911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.129182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.129459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.130140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.132056 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.161343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1191/2383] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:21 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:21.165614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.175767 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8932b-bf25-43d1-b7a4-e90da4d2dc85 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.233073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.233698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.234002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.234262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.234885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.236816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.259147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1193/2384] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:21.263495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.275615 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a98e-e869-442d-a3fb-98a184ed3c55 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.281060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.281665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.281978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.282250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.282909 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.284507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.295160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1192/2385] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:21.299320 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.309987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874f71-6330-4ca3-ad9a-61c2cfdd159a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.315508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77c41-b6d1-42e4-859b-73c133d1d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.316167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77c41-b6d1-42e4-859b-73c133d1d99e admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.316429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77c41-b6d1-42e4-859b-73c133d1d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.316701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77c41-b6d1-42e4-859b-73c133d1d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.317385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf77c41-b6d1-42e4-859b-73c133d1d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.319038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf77c41-b6d1-42e4-859b-73c133d1d99e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.330307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1194/2386] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:21.334548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.344380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705798c-e317-45fa-83cc-7b00c9339181 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.349296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.349966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.350240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.350489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] PATH_INFO: `/v3/projects/e0531676a93c4ef98cb61f61a9b792fc/users/a904e66563754760b36a5e20cdf3cdc4/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.365383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0531676a93c4ef98cb61f61a9b792fc, user_id=a904e66563754760b36a5e20cdf3cdc4, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.368042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.391010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1193/2387] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:21 2022] PUT /identity/v3/projects/e0531676a93c4ef98cb61f61a9b792fc/users/a904e66563754760b36a5e20cdf3cdc4/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:21.402358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.402632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.402898 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.433037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] MFA Rules not processed for user `a904e66563754760b36a5e20cdf3cdc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:21.434337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:21.513938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1195/2388] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:21.517864 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.618857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e51eb-70bd-4c30-ba4d-ffbc2d9d767b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.625196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.625922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.626261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.626592 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.627304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.629208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.658241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1194/2389] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:21 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:21.663019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.677152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3cbd-fee8-4346-8429-495e78bbf751 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.683386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:21.748767 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.749900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.751610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.752801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.752801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.756725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.791955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1196/2390] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:21 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:21.795783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.809905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cfea-5ae6-46fc-a446-29399652982e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.818208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.818875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.819229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.819736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.822417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.824096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.846787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1195/2391] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:21.850701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.862315 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c9180-4453-4659-944a-8cc72015140c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.871321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:21.872057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:21.872826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:21.872826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] PATH_INFO: `/v3/projects/d590d1cb27e14955b306c1defe2c971c/users/d0f6ddceb32d4371bf70e6770def166b/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:21.892649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d590d1cb27e14955b306c1defe2c971c, user_id=d0f6ddceb32d4371bf70e6770def166b, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:21.895369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:21.914922 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1197/2392] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:21 2022] PUT /identity/v3/projects/d590d1cb27e14955b306c1defe2c971c/users/d0f6ddceb32d4371bf70e6770def166b/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:21.918863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:21.937731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103ce5-48cb-4e51-bc96-4b152652e459 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:21.943264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:22.027339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359a63-efc1-4dc3-a17b-1a60607839e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.027973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359a63-efc1-4dc3-a17b-1a60607839e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.028354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359a63-efc1-4dc3-a17b-1a60607839e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.028747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359a63-efc1-4dc3-a17b-1a60607839e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.029720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e359a63-efc1-4dc3-a17b-1a60607839e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.031605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e359a63-efc1-4dc3-a17b-1a60607839e6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.045840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1196/2393] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:22.049802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.060428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008b47-87d6-4e20-bb38-6d4b9477870a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.065878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.066545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.066848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.067119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] PATH_INFO: `/v3/projects/d590d1cb27e14955b306c1defe2c971c/users/d0f6ddceb32d4371bf70e6770def166b/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.069067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d590d1cb27e14955b306c1defe2c971c, user_id=d0f6ddceb32d4371bf70e6770def166b, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.071683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.082725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1198/2394] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:22 2022] PUT /identity/v3/projects/d590d1cb27e14955b306c1defe2c971c/users/d0f6ddceb32d4371bf70e6770def166b/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:22.094074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.094359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.094629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.129651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] MFA Rules not processed for user `d0f6ddceb32d4371bf70e6770def166b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:22.131125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.222685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.226504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1197/2395] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:22.230595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.242110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.244116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.299721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e130-e26c-460e-b5d5-09b35d22370d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.304719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.305650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.306053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.306324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] PATH_INFO: `/v3/users/78db7fd021c44ab58701c01f3afccbe2` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.307419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc227-5798-4a88-959b-6f6f5131834e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.307558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=78db7fd021c44ab58701c01f3afccbe2)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.309377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.311530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.312141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.312448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.312691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.322435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.323825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.333610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1198/2396] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:22.360569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78db7fd021c44ab58701c01f3afccbe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.361249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78db7fd021c44ab58701c01f3afccbe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.363822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.370352 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78db7fd021c44ab58701c01f3afccbe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.371084 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78db7fd021c44ab58701c01f3afccbe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.375156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728763e-77fb-4519-a54c-18563e78eb87 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.377601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:22.380350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.381010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.381416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.381687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] PATH_INFO: `/v3/users/a904e66563754760b36a5e20cdf3cdc4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.382955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a904e66563754760b36a5e20cdf3cdc4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.385091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.390210 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2998c7c7-c2dd-4619-9221-9b90d8b68afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78db7fd021c44ab58701c01f3afccbe2'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.402382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1199/2397] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:22 2022] DELETE /identity/v3/users/78db7fd021c44ab58701c01f3afccbe2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:22.406759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.407175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.407401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.412736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:22.427006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:22.428205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.434265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a904e66563754760b36a5e20cdf3cdc4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.442872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a904e66563754760b36a5e20cdf3cdc4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.443614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a904e66563754760b36a5e20cdf3cdc4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.467566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a904e66563754760b36a5e20cdf3cdc4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.468438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4ccce2e-c6cb-4704-ba32-f027e003428b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a904e66563754760b36a5e20cdf3cdc4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:22.487683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1199/2398] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:22 2022] DELETE /identity/v3/users/a904e66563754760b36a5e20cdf3cdc4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:22.492390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633f13c-0fee-414a-a100-cd171c0d4479 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.492797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633f13c-0fee-414a-a100-cd171c0d4479 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.493335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633f13c-0fee-414a-a100-cd171c0d4479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.510626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1200/2399] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:22.522666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.522904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3633f13c-0fee-414a-a100-cd171c0d4479 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:22.524422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3633f13c-0fee-414a-a100-cd171c0d4479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.524546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.618369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1200/2400] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:22.619969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.620375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.620801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.645280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:22.645834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.647913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5907-7002-4315-b555-299096983dc7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.711955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.712569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.713050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1201/2401] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Aug 31 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:22.713168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.713168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.713857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.723093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.723618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0cf8a-f667-4dae-97f2-1d9efde9a6d6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.724708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.728655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.729558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.730182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.730541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.735660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1201/2402] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:22.736600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.738290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:22.741973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.743539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.757746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1202/2403] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:22.792721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:22.820089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3798-0731-4a46-ad55-64f49f78efe0 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:22.829834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:22.829834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:22.829834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:22.829834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:22.836824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:22.838494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:22.848827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1202/2404] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 11:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:23.295100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:23.296968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:23.344887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbef750-1ebc-4d3d-b003-44c98ded7364 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:23.365097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:23.365795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:23.366151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:23.366481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] PATH_INFO: `/v3/projects/c5a218ad1ef24721816c4dabb96b84da` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:23.367703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a218ad1ef24721816c4dabb96b84da)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:23.370004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:23.459470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:23.482294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:23.483803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:23.503938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a218ad1ef24721816c4dabb96b84da', 'request_id': 'req-60e9a7fc-9c1e-402c-a27f-4faffa386fac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.518421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6bd56-7bb6-4108-a147-a9dbb2fe1d46 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:23.522995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a218ad1ef24721816c4dabb96b84da', 'request_id': 'req-60e9a7fc-9c1e-402c-a27f-4faffa386fac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.547813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a218ad1ef24721816c4dabb96b84da', 'request_id': 'req-60e9a7fc-9c1e-402c-a27f-4faffa386fac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.576962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] The token cache is being invalidate because project c5a218ad1ef24721816c4dabb96b84da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:23.577588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.578990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.581260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1203/2405] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:23 2022] DELETE /identity/v3/projects/c5a218ad1ef24721816c4dabb96b84da => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:23.586681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:23.588839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:23.691765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:23.692577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:23.692861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:23.693143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] PATH_INFO: `/v3/projects/e0531676a93c4ef98cb61f61a9b792fc` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:23.694976 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0531676a93c4ef98cb61f61a9b792fc)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:23.697723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:23.712165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a7fc-9c1e-402c-a27f-4faffa386fac admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:23.728801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:23.729561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:23.730061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:23.730350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] PATH_INFO: `/v3/users/b1e6fe7ab291483ea0262db6232e1dd2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:23.731515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e6fe7ab291483ea0262db6232e1dd2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:23.734122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:23.791907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0531676a93c4ef98cb61f61a9b792fc', 'request_id': 'req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.805462 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0531676a93c4ef98cb61f61a9b792fc', 'request_id': 'req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.824047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0531676a93c4ef98cb61f61a9b792fc', 'request_id': 'req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.860732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] The token cache is being invalidate because project e0531676a93c4ef98cb61f61a9b792fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:23.878885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.881437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.883677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1203/2406] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:23 2022] DELETE /identity/v3/projects/e0531676a93c4ef98cb61f61a9b792fc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:23.887283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e6fe7ab291483ea0262db6232e1dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.897434 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:23.901452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:23.918119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e6fe7ab291483ea0262db6232e1dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.919198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e6fe7ab291483ea0262db6232e1dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.965156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e6fe7ab291483ea0262db6232e1dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:23.966920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e6fe7ab291483ea0262db6232e1dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:24.001762 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1204/2407] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:23 2022] DELETE /identity/v3/users/b1e6fe7ab291483ea0262db6232e1dd2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:24.042668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:24.049262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758e35-04ec-41d7-a3d6-f5a60f2b3341 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:24.172700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:24.173825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:24.174365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:24.174873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] PATH_INFO: `/v3/users/d0f6ddceb32d4371bf70e6770def166b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:24.177612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f6ddceb32d4371bf70e6770def166b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:24.180615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:24.264136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f6ddceb32d4371bf70e6770def166b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:24.265072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f6ddceb32d4371bf70e6770def166b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:24.278075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f6ddceb32d4371bf70e6770def166b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:24.279051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f6ddceb32d4371bf70e6770def166b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:24.322238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d40d49fe-9780-41aa-8df6-b2a0cccaac41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f6ddceb32d4371bf70e6770def166b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:24.349731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1204/2408] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:23 2022] DELETE /identity/v3/users/d0f6ddceb32d4371bf70e6770def166b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:24.866901 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:24.868373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:24.892258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa40a2-859c-42a4-b1b0-d961fc096211 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:24.964867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:25.025268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.025268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.025268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.025268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] PATH_INFO: `/v3/projects/d590d1cb27e14955b306c1defe2c971c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.025783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d590d1cb27e14955b306c1defe2c971c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.036523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.142974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd590d1cb27e14955b306c1defe2c971c', 'request_id': 'req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.152988 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd590d1cb27e14955b306c1defe2c971c', 'request_id': 'req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.171574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd590d1cb27e14955b306c1defe2c971c', 'request_id': 'req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.204623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] The token cache is being invalidate because project d590d1cb27e14955b306c1defe2c971c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:25.204856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.205905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d7e2f9e-f6d8-491d-abd0-b8ab6850c5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.207992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1205/2409] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:24 2022] DELETE /identity/v3/projects/d590d1cb27e14955b306c1defe2c971c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:25.213271 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.213921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.214403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.237715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:25.239158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:25.330496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1205/2410] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:25.339639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.340014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.340383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.362583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:25.364099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:25.373714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1206/2411] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:25.388704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.399803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b8cf-45f6-454b-b99b-056ddbfff647 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.406217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.406988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.407270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.407543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.408489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:25.408489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.410520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.427636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1206/2412] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:25.432255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.459473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a4bf-cbc0-4eef-b01a-ff52b0a0d662 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.487816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.488035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.491145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:25.492073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.492373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.492626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.493333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.499465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.526333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb917-7000-45a7-bda2-40593090d0dc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.546852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.547551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.548319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.548667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] PATH_INFO: `/v3/projects/b68d9b9e9cb448aeab30d7e0744a8b5d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.551250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68d9b9e9cb448aeab30d7e0744a8b5d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.556141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.569668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:25.608297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1207/2413] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:25.610324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.679276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68d9b9e9cb448aeab30d7e0744a8b5d', 'request_id': 'req-26e7a2d9-de27-41b9-a634-93d174555c41'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.690429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68d9b9e9cb448aeab30d7e0744a8b5d', 'request_id': 'req-26e7a2d9-de27-41b9-a634-93d174555c41'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.705129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68d9b9e9cb448aeab30d7e0744a8b5d', 'request_id': 'req-26e7a2d9-de27-41b9-a634-93d174555c41'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.710531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72aed-42e4-41a8-b786-040a8699795b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.743270 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] The token cache is being invalidate because project b68d9b9e9cb448aeab30d7e0744a8b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:25.743549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.750862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-26e7a2d9-de27-41b9-a634-93d174555c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:25.759530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1207/2414] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:25 2022] DELETE /identity/v3/projects/b68d9b9e9cb448aeab30d7e0744a8b5d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:25.761548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4204-5a93-4a38-8041-e0b000853f9e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.761985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4204-5a93-4a38-8041-e0b000853f9e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.762135 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4204-5a93-4a38-8041-e0b000853f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.786482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:25.802954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.803936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.804286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.804405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-958d4204-5a93-4a38-8041-e0b000853f9e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:25.804678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.805386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.805872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-958d4204-5a93-4a38-8041-e0b000853f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:25.808181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.833842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1208/2415] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:25.848111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.848704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.849171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.855813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1208/2416] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:25.861148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.864799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:25.879931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:25.881244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:25.885165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d82a-dfaa-4930-9a19-c439c6e47d74 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.892496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.893387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.893835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.894174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.895053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.897121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.901602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1209/2417] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:25.905626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.910608 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1209/2418] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:25.914484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.919382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1869475-607e-4fa6-be21-c1ebf084b226 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.924209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.924947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.925291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.925638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.925754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0803c93-2e1b-471b-8b8d-9d4dc93e0c67 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.926537 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:25.926903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.928587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.931055 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.931190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.931440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.931825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.932814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.934859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.946787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1210/2419] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:25.947429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1210/2420] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:01:25.953945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.954930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:25.965237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43df54-3ea8-4798-9244-aec44ce3b0dc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.966599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf527d-6d6a-4035-995b-6bb0e661ffae admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:25.972693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c503d-c906-47df-a30f-44cd1e9cdbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.973443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c503d-c906-47df-a30f-44cd1e9cdbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.973738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c503d-c906-47df-a30f-44cd1e9cdbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.974066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c503d-c906-47df-a30f-44cd1e9cdbdd admin admin] PATH_INFO: `/v3/projects/57be900280a449afa10c8f7f3c18a7b2/users/c96b978090b649eab814075a272d6457/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.978861 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:25.979494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:25.979775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:25.981575 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:25.982238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:25.984418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:25.997650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c503d-c906-47df-a30f-44cd1e9cdbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=57be900280a449afa10c8f7f3c18a7b2, user_id=c96b978090b649eab814075a272d6457, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.005965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c503d-c906-47df-a30f-44cd1e9cdbdd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.019661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1211/2421] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:25 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:26.020244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1211/2422] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:25 2022] PUT /identity/v3/projects/57be900280a449afa10c8f7f3c18a7b2/users/c96b978090b649eab814075a272d6457/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:26.024088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.032957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.037334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.037880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.076271 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] MFA Rules not processed for user `c96b978090b649eab814075a272d6457`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:26.077573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:26.151018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe31fe-5854-4ebf-a270-0ed9dd4ae243 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.155977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.156785 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.157125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.157457 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.158764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.161250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.193805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1212/2423] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:26.196255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.205260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1212/2424] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:26.206658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62c69-f48c-41d3-8c79-18ef492b0764 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.209693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.211454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.212177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.212555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.212919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.213866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.215595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.220606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2407f3f-05aa-48e6-8cda-ace2c9a447f9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.227037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1213/2425] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:26.230983 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.234234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.235001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.235387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.235559 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.236247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.239421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.241987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de3025-4070-4f85-b4db-85b03475f89f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.246649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.247262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.247545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.247815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.248495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.250197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.262040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1214/2426] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:26.266665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.290512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f42c8-af09-4f98-9311-5d60412d92e4 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.296459 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819fc7f-57ea-4eeb-ae10-298ac6ae80b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.297261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819fc7f-57ea-4eeb-ae10-298ac6ae80b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.308604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1213/2427] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:26.309917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819fc7f-57ea-4eeb-ae10-298ac6ae80b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.310397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819fc7f-57ea-4eeb-ae10-298ac6ae80b1 admin admin] PATH_INFO: `/v3/projects/ae74f3dd494944c7a1149d33395057de/users/c9bc249d9a934b2c95ee32ee4f64fd2e/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.313948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.336711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:26.340819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819fc7f-57ea-4eeb-ae10-298ac6ae80b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae74f3dd494944c7a1149d33395057de, user_id=c9bc249d9a934b2c95ee32ee4f64fd2e, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.344368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819fc7f-57ea-4eeb-ae10-298ac6ae80b1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.365296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1215/2428] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:26 2022] PUT /identity/v3/projects/ae74f3dd494944c7a1149d33395057de/users/c9bc249d9a934b2c95ee32ee4f64fd2e/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:26.375700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.376244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.376527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.414121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:26.421159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8f0bd-c716-4c30-bd31-ac1bee10145e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.430766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] MFA Rules not processed for user `c9bc249d9a934b2c95ee32ee4f64fd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:26.432018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:26.502295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.503218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.503652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.504067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.505410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.508770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.542672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1214/2429] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:26.546415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.556231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1216/2430] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:26.561791 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.569358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b19bed-cbc3-4330-89b5-82b942ba29dc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.579197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.581087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.582038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.582357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.584031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.590107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3bf2-06d3-4ed4-855e-b5782261ca33 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.595792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.596419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.596749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.597023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.597662 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.600385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.601807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.626080 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1215/2431] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:26.628134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.644033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1217/2432] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:26.645817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:26.649873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce7d6-9016-4bfb-a39b-2c33c2682063 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.856599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.861599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.869171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.869795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] PATH_INFO: `/v3/projects/4dcddd506e6c4d838a66b00912ad2101/users/60aa51f03478486f9a31c28cf2a13caa/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.915455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebe14-3203-4ca0-b339-f6b7b118f4fd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:26.941717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:26.941717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:26.941717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:26.941717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:26.942298 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.942922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcddd506e6c4d838a66b00912ad2101, user_id=60aa51f03478486f9a31c28cf2a13caa, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:26.946618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.947516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:26.971526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1216/2433] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:26 2022] PUT /identity/v3/projects/4dcddd506e6c4d838a66b00912ad2101/users/60aa51f03478486f9a31c28cf2a13caa/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:26.982347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.033118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1218/2434] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:26 2022] POST /identity/v3/users => generated 288 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:27.035834 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.072254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9e7d9-6c00-4c34-a40d-fb4ea9020586 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.172140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c9239-4aaf-446b-9376-c52f8f6f7d1d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.179065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:27.182689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.184152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.184763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.185259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.186993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.190527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.198429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.199406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.199827 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.200228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.201019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.203034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.215571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1219/2435] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:27.218421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1217/2436] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:27.222150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.223233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.235386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:27.236700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c6cd6-a9c5-4f71-b69b-fd749a89b5b0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.244226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.244899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.245176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.245571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] PATH_INFO: `/v3/projects/4dac31d16a5d4918a02a669d16a7ef7a/users/79dd49d47785419e8e5c6938fe331409/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.249259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc9a72-e785-4409-bac4-f507462a6d17 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.257066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5326a-de65-4299-aebc-e1d44b55155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.258189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5326a-de65-4299-aebc-e1d44b55155f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.258678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5326a-de65-4299-aebc-e1d44b55155f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.259120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5326a-de65-4299-aebc-e1d44b55155f admin admin] PATH_INFO: `/v3/projects/4dcddd506e6c4d838a66b00912ad2101/users/60aa51f03478486f9a31c28cf2a13caa/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.262758 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5326a-de65-4299-aebc-e1d44b55155f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcddd506e6c4d838a66b00912ad2101, user_id=60aa51f03478486f9a31c28cf2a13caa, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.268210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5326a-de65-4299-aebc-e1d44b55155f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.275682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dac31d16a5d4918a02a669d16a7ef7a, user_id=79dd49d47785419e8e5c6938fe331409, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.279332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.285299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1218/2437] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:27 2022] PUT /identity/v3/projects/4dcddd506e6c4d838a66b00912ad2101/users/60aa51f03478486f9a31c28cf2a13caa/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:27.303552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.303936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.304284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.306011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1220/2438] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:27 2022] PUT /identity/v3/projects/4dac31d16a5d4918a02a669d16a7ef7a/users/79dd49d47785419e8e5c6938fe331409/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:27.311947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.355725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] MFA Rules not processed for user `60aa51f03478486f9a31c28cf2a13caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:27.357145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:27.457919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1219/2439] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:27.470457 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a9cf-281b-4ac1-851a-e5595fb73d6d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.470894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.473954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:27.482581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.483291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.483562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.483830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.484471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.486156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.497670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1221/2440] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:27.509973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.531183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faf36a-b747-4929-9be4-865c87c0e19a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.537469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01ce8-668b-47c1-ac24-a03a503e3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.538318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01ce8-668b-47c1-ac24-a03a503e3132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.538686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01ce8-668b-47c1-ac24-a03a503e3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.539068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01ce8-668b-47c1-ac24-a03a503e3132 admin admin] PATH_INFO: `/v3/projects/4dac31d16a5d4918a02a669d16a7ef7a/users/79dd49d47785419e8e5c6938fe331409/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.541407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01ce8-668b-47c1-ac24-a03a503e3132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dac31d16a5d4918a02a669d16a7ef7a, user_id=79dd49d47785419e8e5c6938fe331409, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.544593 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01ce8-668b-47c1-ac24-a03a503e3132 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.567184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1222/2441] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:27 2022] PUT /identity/v3/projects/4dac31d16a5d4918a02a669d16a7ef7a/users/79dd49d47785419e8e5c6938fe331409/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:27.581605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.582047 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.582412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.604253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0eaf3-fc06-448a-ac04-1ab22179045e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.626637 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] MFA Rules not processed for user `79dd49d47785419e8e5c6938fe331409`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:27.627980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:27.699981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.701103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.701686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.702309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.743244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1223/2442] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:27.751693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.754795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:27.777122 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2361c-b592-4a35-b287-d08b84cdb151 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:27.780932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:27.781556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:27.781877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:27.782139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:27.787493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:27.799147 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.800618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.820284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:27.821497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1224/2443] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:27.822837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:27.859135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1220/2444] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:27.956779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:27.989444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:28.001105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:28.018385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe4e4e-8ea8-49d8-821a-73e71c6721d4 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:28.030892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b796c81-de74-427c-992a-5a6f0d37bdaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:28.031870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b796c81-de74-427c-992a-5a6f0d37bdaf service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:28.032733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b796c81-de74-427c-992a-5a6f0d37bdaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:28.033352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b796c81-de74-427c-992a-5a6f0d37bdaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:28.125800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f575d7-99ea-4c48-96f7-1c830f683377 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:28.133377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:28.134199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:28.134889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:28.135252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] PATH_INFO: `/v3/users/c96b978090b649eab814075a272d6457` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:28.138589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96b978090b649eab814075a272d6457)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:28.142452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:28.180207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b796c81-de74-427c-992a-5a6f0d37bdaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:28.181860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b796c81-de74-427c-992a-5a6f0d37bdaf service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:28.207529 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1221/2445] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:28.285729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96b978090b649eab814075a272d6457'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:28.287959 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96b978090b649eab814075a272d6457'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:28.306554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96b978090b649eab814075a272d6457'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:28.308531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96b978090b649eab814075a272d6457'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:28.333612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96b978090b649eab814075a272d6457'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:28.358719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1225/2446] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:27 2022] DELETE /identity/v3/users/c96b978090b649eab814075a272d6457 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:28.364821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350465-6639-4e4d-a65a-19115251a14b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:28.365735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350465-6639-4e4d-a65a-19115251a14b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:28.366557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350465-6639-4e4d-a65a-19115251a14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:28.392862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-50350465-6639-4e4d-a65a-19115251a14b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:28.394733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-50350465-6639-4e4d-a65a-19115251a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:28.533473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1222/2447] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:28.544372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:28.546161 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:28.607610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05323261-2660-4f8f-83d8-694b660424b6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:28.611273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:28.611934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:28.612153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:28.612421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:28.622847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:28.624410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:28.635037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1226/2448] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:29.006870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350465-6639-4e4d-a65a-19115251a14b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:29.009008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-50350465-6639-4e4d-a65a-19115251a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:29.026770 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350465-6639-4e4d-a65a-19115251a14b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:29.031545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:29.032288 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:29.032627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:29.032961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] PATH_INFO: `/v3/projects/57be900280a449afa10c8f7f3c18a7b2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:29.034315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57be900280a449afa10c8f7f3c18a7b2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:29.036909 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:29.126125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57be900280a449afa10c8f7f3c18a7b2', 'request_id': 'req-f4c83e06-cc23-4362-a4a4-8225129f140d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.133012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57be900280a449afa10c8f7f3c18a7b2', 'request_id': 'req-f4c83e06-cc23-4362-a4a4-8225129f140d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.151154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57be900280a449afa10c8f7f3c18a7b2', 'request_id': 'req-f4c83e06-cc23-4362-a4a4-8225129f140d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.174302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] The token cache is being invalidate because project 57be900280a449afa10c8f7f3c18a7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:29.174302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.174779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.176714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1223/2449] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:29 2022] DELETE /identity/v3/projects/57be900280a449afa10c8f7f3c18a7b2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:29.181121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:29.192759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d48f1-585d-4fbf-8bfc-58825acc65fe service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:29.260448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:29.320688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:29.321497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:29.321897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:29.322261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] PATH_INFO: `/v3/users/60aa51f03478486f9a31c28cf2a13caa` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:29.325050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60aa51f03478486f9a31c28cf2a13caa)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:29.327385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:29.406540 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60aa51f03478486f9a31c28cf2a13caa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.407266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60aa51f03478486f9a31c28cf2a13caa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.419067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60aa51f03478486f9a31c28cf2a13caa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.420040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60aa51f03478486f9a31c28cf2a13caa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.434109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4c8920e7-80b2-416f-b35b-425b9cf4dbf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60aa51f03478486f9a31c28cf2a13caa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:29.450357 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1227/2450] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:29 2022] DELETE /identity/v3/users/60aa51f03478486f9a31c28cf2a13caa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:29.822779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:29.824661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:29.839919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:29.848482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c83e06-cc23-4362-a4a4-8225129f140d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:29.969729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:29.970533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:29.970888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:29.972164 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] PATH_INFO: `/v3/projects/4dcddd506e6c4d838a66b00912ad2101` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:29.972535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcddd506e6c4d838a66b00912ad2101)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:29.974718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.067088 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcddd506e6c4d838a66b00912ad2101', 'request_id': 'req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:30.073704 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcddd506e6c4d838a66b00912ad2101', 'request_id': 'req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:30.082641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcddd506e6c4d838a66b00912ad2101', 'request_id': 'req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:30.094100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] The token cache is being invalidate because project 4dcddd506e6c4d838a66b00912ad2101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:30.094450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:30.095153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-df8daa8d-23c6-4158-8cb4-f41fdb0aef57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:30.096736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1224/2451] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:29 2022] DELETE /identity/v3/projects/4dcddd506e6c4d838a66b00912ad2101 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:30.101844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.102712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.103054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.127121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:30.128336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:30.188571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1228/2452] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:30.196584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.196868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.197676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.217468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:30.218815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:30.227392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1225/2453] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:30.232018 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.242133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1f9fb-497e-470f-a2b0-defb17bb1e9e None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.246996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.247590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.247865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.248132 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.248786 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:30.249081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.250719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.262738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1229/2454] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:01:30.267490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.277192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866ad1f-5848-49c8-bf46-e3c2c52cef39 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.282385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.283014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.283330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.283598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.284219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.286238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.315222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1226/2455] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:30.320780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.331221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4619c6a-4c2d-427f-95c3-b6b31138d794 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.380226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:30.413676 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.414658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.420548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.421032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.421934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.424727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.457807 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1230/2456] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:30.461958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.474698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73deeb-0f9c-4169-8fd2-ed8a8d6c24aa admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.484969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.485601 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.485924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.486469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.498892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.500802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.519721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1227/2457] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:30.523539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.534184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af19c-0fcc-4233-bf4f-34a0b16a5a78 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.539428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95e824-2cb0-4906-969f-7ce7d2c9a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.540159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e824-2cb0-4906-969f-7ce7d2c9a81a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.540543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e824-2cb0-4906-969f-7ce7d2c9a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.540933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e824-2cb0-4906-969f-7ce7d2c9a81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.541677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95e824-2cb0-4906-969f-7ce7d2c9a81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.543451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95e824-2cb0-4906-969f-7ce7d2c9a81a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.560388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.565548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1231/2458] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:30.571079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb0ec2-32f9-48eb-99b0-1c0c168ddf87 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.576464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.577228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.577538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.577763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] PATH_INFO: `/v3/projects/72ce5d142d5d407bb8fe52b3a45fdbc8/users/15615cb234fa476499c30bae496be272/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.604767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ce5d142d5d407bb8fe52b3a45fdbc8, user_id=15615cb234fa476499c30bae496be272, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.607840 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.628213 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1228/2459] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:30 2022] PUT /identity/v3/projects/72ce5d142d5d407bb8fe52b3a45fdbc8/users/15615cb234fa476499c30bae496be272/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:30.645195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.645528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.645844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.694211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] MFA Rules not processed for user `15615cb234fa476499c30bae496be272`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:30.695592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:30.769795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1232/2460] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:30.774411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.850539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:30.896686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489e67e-cbc2-4649-9636-10e1c2de97ac admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:30.901484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:30.902136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:30.902407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:30.902700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:30.903991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:30.905980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:30.938467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1229/2461] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:30.942638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:30.954772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41514c35-fe7c-43b5-8907-fc2fb032a864 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.046759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.047384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.047701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.047972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.048613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.050672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.083765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1233/2462] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:30 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:31.084981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.095681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f584e-b37e-46f3-9120-fe204534d665 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.100291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.100897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.101170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.101439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.102139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.103843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.114540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1230/2463] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:31.118570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.132290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570610fa-c5ff-41a5-b0cf-82d171061860 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.139375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.140399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.140777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.141148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] PATH_INFO: `/v3/projects/8305561ea8814deab427b9596b25f316/users/db35181f285c4ee3935bd35be475154f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.172912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8305561ea8814deab427b9596b25f316, user_id=db35181f285c4ee3935bd35be475154f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.184475 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.207900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1234/2464] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:31 2022] PUT /identity/v3/projects/8305561ea8814deab427b9596b25f316/users/db35181f285c4ee3935bd35be475154f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:31.208630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.224211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48656-03ca-466d-bfc1-b7348133b0d5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.270219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.272186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:31.290152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:31.303541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.304454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.304959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.305380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.306916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.308848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.322172 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1231/2465] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:31.326390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.338447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbaa02-84af-4421-9979-b6b7f519a131 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.343672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efeb40-832b-415d-a27f-50ec6d68ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.344861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efeb40-832b-415d-a27f-50ec6d68ca9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.345327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efeb40-832b-415d-a27f-50ec6d68ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.345795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efeb40-832b-415d-a27f-50ec6d68ca9c admin admin] PATH_INFO: `/v3/projects/8305561ea8814deab427b9596b25f316/users/db35181f285c4ee3935bd35be475154f/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.349052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efeb40-832b-415d-a27f-50ec6d68ca9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8305561ea8814deab427b9596b25f316, user_id=db35181f285c4ee3935bd35be475154f, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.351962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efeb40-832b-415d-a27f-50ec6d68ca9c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.352107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcbf08-18ed-4e36-b246-da53c0f94568 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.357245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.357974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.358255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.358524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] PATH_INFO: `/v3/users/c9bc249d9a934b2c95ee32ee4f64fd2e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.359647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bc249d9a934b2c95ee32ee4f64fd2e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.361618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.367114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1232/2466] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:31 2022] PUT /identity/v3/projects/8305561ea8814deab427b9596b25f316/users/db35181f285c4ee3935bd35be475154f/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:31.377522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.378199 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.378546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.409293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] MFA Rules not processed for user `db35181f285c4ee3935bd35be475154f`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:31.410594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:31.414538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bc249d9a934b2c95ee32ee4f64fd2e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:31.415216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bc249d9a934b2c95ee32ee4f64fd2e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:31.425450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bc249d9a934b2c95ee32ee4f64fd2e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:31.426336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bc249d9a934b2c95ee32ee4f64fd2e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:31.439025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebe7b3c2-246d-4574-abd2-bbeb08e8eeba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bc249d9a934b2c95ee32ee4f64fd2e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:31.451032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1235/2467] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:31 2022] DELETE /identity/v3/users/c9bc249d9a934b2c95ee32ee4f64fd2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:31.456499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.456779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.457046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.482560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:31.483848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:31.491814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1233/2468] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:31.503357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.504807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:31.522546 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:31.550630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1236/2469] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:31.563411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.564878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:31.574065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fdde7-bad6-43a9-b2bf-4a7efdcde810 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.606036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:31.622976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.623655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.623935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.624208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.625619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fdd25-e911-4634-857f-896ea2e8955c None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.629182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.629812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.630086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.630366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.639191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.640674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.652145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1237/2470] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:31.696203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.697687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.709886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1234/2471] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:31.823799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:31.839398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1bd45-507c-4016-be7c-c3a7e24eae17 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:31.843988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:31.844156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:31.844661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:31.845105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:31.847510 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:31.929067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:31.930722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:31.941585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1238/2472] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:32.062685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:32.064156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:32.079801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6dac7-928f-408d-9626-a2b869b058e4 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:32.086331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:32.087035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:32.087242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:32.087503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] PATH_INFO: `/v3/projects/ae74f3dd494944c7a1149d33395057de` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:32.088696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae74f3dd494944c7a1149d33395057de)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:32.090665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:32.139845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae74f3dd494944c7a1149d33395057de', 'request_id': 'req-7a5855f7-e832-4f74-991a-adb668d82606'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.146350 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae74f3dd494944c7a1149d33395057de', 'request_id': 'req-7a5855f7-e832-4f74-991a-adb668d82606'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.154358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae74f3dd494944c7a1149d33395057de', 'request_id': 'req-7a5855f7-e832-4f74-991a-adb668d82606'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.162429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:32.167314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] The token cache is being invalidate because project ae74f3dd494944c7a1149d33395057de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:32.167928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.169141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.172104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1235/2473] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:32 2022] DELETE /identity/v3/projects/ae74f3dd494944c7a1149d33395057de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:32.176992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:32.189244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23448-abe4-4f10-93e8-daf60c491aa8 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:32.262538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:32.263386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:32.263768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:32.264143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] PATH_INFO: `/v3/users/79dd49d47785419e8e5c6938fe331409` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:32.265535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dd49d47785419e8e5c6938fe331409)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:32.267923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:32.324707 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dd49d47785419e8e5c6938fe331409'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.325693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dd49d47785419e8e5c6938fe331409'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.336635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dd49d47785419e8e5c6938fe331409'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.337546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dd49d47785419e8e5c6938fe331409'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.351962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0cfec87e-fb7e-43ad-b75d-8521bfa87ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dd49d47785419e8e5c6938fe331409'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.357993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:32.368143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1239/2474] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:32 2022] DELETE /identity/v3/users/79dd49d47785419e8e5c6938fe331409 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:32.656913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:32.658457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:32.674134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5855f7-e832-4f74-991a-adb668d82606 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:32.732581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:32.733145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:32.733418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:32.733687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] PATH_INFO: `/v3/projects/4dac31d16a5d4918a02a669d16a7ef7a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:32.734985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dac31d16a5d4918a02a669d16a7ef7a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:32.736920 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:32.784824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dac31d16a5d4918a02a669d16a7ef7a', 'request_id': 'req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.791090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dac31d16a5d4918a02a669d16a7ef7a', 'request_id': 'req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.799509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dac31d16a5d4918a02a669d16a7ef7a', 'request_id': 'req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.810676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] The token cache is being invalidate because project 4dac31d16a5d4918a02a669d16a7ef7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:32.810956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.811905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6c6ed5b9-d140-42a1-a74d-70d9893fcd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:32.813437 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1236/2475] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:32 2022] DELETE /identity/v3/projects/4dac31d16a5d4918a02a669d16a7ef7a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:32.820237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:32.820588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:32.820956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:32.846305 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:32.848180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:32.907428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1240/2476] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:32.915473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:32.915755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:32.916012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:32.937180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:32.938481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:32.947022 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1237/2477] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:32.951348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:32.961485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2280fa1-c314-4e3e-8024-da7757d65360 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:32.966640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:32.967304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:32.967651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:32.967924 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:32.968564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:32.968865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:32.970517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:32.983667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1241/2478] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:32.987999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:32.997396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814f3fc-647c-4a29-8174-55eae55515dd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.002266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.002870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.003142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.003408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.004050 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.005974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.038320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1238/2479] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:32 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:33.039590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.050394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eee97-a62d-42ab-9b4d-cd78a58a54cd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.112130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.112770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.113052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.113328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.114007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.115991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.139109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1242/2480] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:33 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:33.143189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.154023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa136a8-5aa6-4c41-8d4b-82227c7efa90 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.158827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.159474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.159754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.160016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.160668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.162375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.174702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1239/2481] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:33.176935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.188269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104a47b-89ed-408c-b8b5-62a1a9ad8674 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.193384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a15d-99e4-4af3-8a52-d369228a3067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.194166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a15d-99e4-4af3-8a52-d369228a3067 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.194594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a15d-99e4-4af3-8a52-d369228a3067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.194991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a15d-99e4-4af3-8a52-d369228a3067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.196452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a15d-99e4-4af3-8a52-d369228a3067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.197673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a15d-99e4-4af3-8a52-d369228a3067 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.210458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1243/2482] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:33.214882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.230536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7fc0-50ab-46de-b1fb-65ab7a42ed9f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.235253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.235910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.236190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.236460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] PATH_INFO: `/v3/projects/1eec7e3c52cb44f68562b177633c44b9/users/20b6c288f096422c80d4195cd6b4d970/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.251308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eec7e3c52cb44f68562b177633c44b9, user_id=20b6c288f096422c80d4195cd6b4d970, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.254001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.268180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1240/2483] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:33 2022] PUT /identity/v3/projects/1eec7e3c52cb44f68562b177633c44b9/users/20b6c288f096422c80d4195cd6b4d970/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:33.279973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.280257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.280526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.308410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] MFA Rules not processed for user `20b6c288f096422c80d4195cd6b4d970`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:33.309685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:33.357869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:33.378962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1244/2484] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:33.383452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.424501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:33.468918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b76a-913c-406f-be3e-9fd9f5004520 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.478296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.478985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.479680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.480100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.480912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.483883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.515961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1241/2485] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:33 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:33.520813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.533445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32734f-35b3-458f-b4f1-4c2ecd7e2ed1 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.590816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.591525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.591803 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.592070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.592789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.594729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.617620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1245/2486] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:33 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:33.621953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.632345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a76f1-ef3c-4c5b-af1d-10f828198601 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.636896 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.637493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.637783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.638181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.638823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.640453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.651344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1242/2487] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:33.657450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.669153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9949-37df-435f-aa7e-f044a0ab5c05 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.676955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.677961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.678339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.678717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] PATH_INFO: `/v3/projects/f4d8289ccdd34d7cb165a469bd302cdc/users/ad49c0f330384d7eae44060b097c6baa/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.698482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d8289ccdd34d7cb165a469bd302cdc, user_id=ad49c0f330384d7eae44060b097c6baa, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.701199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.717944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1246/2488] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:33 2022] PUT /identity/v3/projects/f4d8289ccdd34d7cb165a469bd302cdc/users/ad49c0f330384d7eae44060b097c6baa/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:33.722396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.733335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f878e4-e469-419e-bc62-6b093844ffa5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.799064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fdcd0-cf93-442f-a0d2-17c9f24ba471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.799675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fdcd0-cf93-442f-a0d2-17c9f24ba471 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.799946 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fdcd0-cf93-442f-a0d2-17c9f24ba471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.800212 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fdcd0-cf93-442f-a0d2-17c9f24ba471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.800941 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fdcd0-cf93-442f-a0d2-17c9f24ba471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.802647 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fdcd0-cf93-442f-a0d2-17c9f24ba471 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.814659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1243/2489] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:33.818564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.829536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8975a-b8b5-4c5d-9bdd-8163fa1ad7cc admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:33.834962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:33.835708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.835975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.836248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] PATH_INFO: `/v3/projects/f4d8289ccdd34d7cb165a469bd302cdc/users/ad49c0f330384d7eae44060b097c6baa/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.838307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d8289ccdd34d7cb165a469bd302cdc, user_id=ad49c0f330384d7eae44060b097c6baa, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:33.841056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:33.856364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1247/2490] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:33 2022] PUT /identity/v3/projects/f4d8289ccdd34d7cb165a469bd302cdc/users/ad49c0f330384d7eae44060b097c6baa/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:33.866013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:33.866388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:33.866887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:33.899508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] MFA Rules not processed for user `ad49c0f330384d7eae44060b097c6baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:33.900794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:33.983972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1244/2491] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:33.995776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:33.999711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:34.059330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5d7a-6c10-4c44-a46d-59be7876a5e5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:34.064389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e07e4-f2d6-46dc-962f-44ed82a0727e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:34.065223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e07e4-f2d6-46dc-962f-44ed82a0727e service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:34.065650 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e07e4-f2d6-46dc-962f-44ed82a0727e service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:34.066053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e07e4-f2d6-46dc-962f-44ed82a0727e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:34.076731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e07e4-f2d6-46dc-962f-44ed82a0727e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:34.078364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e07e4-f2d6-46dc-962f-44ed82a0727e service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:34.088503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1248/2492] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:34.578594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:34.580683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:34.614779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:34.677058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbb86b-cfaa-4021-a6bc-07e97004a111 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:34.684275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:34.685440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:34.685870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:34.686854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] PATH_INFO: `/v3/users/15615cb234fa476499c30bae496be272` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:34.688591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15615cb234fa476499c30bae496be272)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:34.691316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:34.778971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15615cb234fa476499c30bae496be272'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:34.792703 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15615cb234fa476499c30bae496be272'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:34.793331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15615cb234fa476499c30bae496be272'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:34.830030 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15615cb234fa476499c30bae496be272'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:34.830822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15615cb234fa476499c30bae496be272'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:34.850972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1245/2493] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:34 2022] DELETE /identity/v3/users/15615cb234fa476499c30bae496be272 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:34.855464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:34.856019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:34.856019 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:34.876611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:34.877905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:34.934345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:34.961925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1249/2494] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:34.979097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:34.981311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:35.086478 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc235ff-da61-4bd6-86cf-2a18bbae1ea0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:35.092034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:35.093244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:35.093656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:35.094119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:35.115369 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:35.116850 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:35.129985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1246/2495] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:35.513268 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:35.514951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:35.526965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747a3d5-195b-4f3c-b9ce-9d8a1501014a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:35.531619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:35.532257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:35.532532 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:35.532822 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] PATH_INFO: `/v3/projects/72ce5d142d5d407bb8fe52b3a45fdbc8` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:35.533938 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ce5d142d5d407bb8fe52b3a45fdbc8)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:35.535853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:35.599545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ce5d142d5d407bb8fe52b3a45fdbc8', 'request_id': 'req-f1117d8b-58b1-4a21-aefb-2968a05c189f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.607233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ce5d142d5d407bb8fe52b3a45fdbc8', 'request_id': 'req-f1117d8b-58b1-4a21-aefb-2968a05c189f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.618236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ce5d142d5d407bb8fe52b3a45fdbc8', 'request_id': 'req-f1117d8b-58b1-4a21-aefb-2968a05c189f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.629946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] The token cache is being invalidate because project 72ce5d142d5d407bb8fe52b3a45fdbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:35.630235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.630874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.632966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1250/2496] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:35 2022] DELETE /identity/v3/projects/72ce5d142d5d407bb8fe52b3a45fdbc8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:35.636971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:35.649589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910f4b-7cde-4c5d-a63f-eb627b9f6269 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:35.715838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:35.733151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:35.733924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:35.734331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:35.734682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] PATH_INFO: `/v3/users/db35181f285c4ee3935bd35be475154f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:35.735923 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db35181f285c4ee3935bd35be475154f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:35.737821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:35.739840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:35.741290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:35.753947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1117d8b-58b1-4a21-aefb-2968a05c189f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:35.758546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:35.759168 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:35.759444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:35.759712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] PATH_INFO: `/v3/users/20b6c288f096422c80d4195cd6b4d970` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:35.760810 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b6c288f096422c80d4195cd6b4d970)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:35.762802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:35.791344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db35181f285c4ee3935bd35be475154f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.800575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db35181f285c4ee3935bd35be475154f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.801221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db35181f285c4ee3935bd35be475154f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.814904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db35181f285c4ee3935bd35be475154f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.815433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b6c288f096422c80d4195cd6b4d970'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.815586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c022f0e4-6b3a-42e3-b4c9-6a43e2f29402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db35181f285c4ee3935bd35be475154f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.816137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b6c288f096422c80d4195cd6b4d970'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.827334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b6c288f096422c80d4195cd6b4d970'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.828177 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b6c288f096422c80d4195cd6b4d970'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.832495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1247/2497] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:35 2022] DELETE /identity/v3/users/db35181f285c4ee3935bd35be475154f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:35.844960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b6c288f096422c80d4195cd6b4d970'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:35.858833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1251/2498] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:35 2022] DELETE /identity/v3/users/20b6c288f096422c80d4195cd6b4d970 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:35.863671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:35.864015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:35.864442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:35.890509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:35.892065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:35.957036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1248/2499] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:35.968082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:35.969582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.023521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:36.036551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eca31-1c82-484f-a456-a714f23ce32a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.040709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781071-a958-4258-a559-3e3dccc93317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.041439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781071-a958-4258-a559-3e3dccc93317 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.041719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781071-a958-4258-a559-3e3dccc93317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.042026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781071-a958-4258-a559-3e3dccc93317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.051840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1781071-a958-4258-a559-3e3dccc93317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.053291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1781071-a958-4258-a559-3e3dccc93317 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.063444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1252/2500] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:36.252922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.254333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.267104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e03ab-531a-4fd8-aa57-ed9eb013b278 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.272037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.272665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.272940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.273219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] PATH_INFO: `/v3/projects/8305561ea8814deab427b9596b25f316` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.275036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8305561ea8814deab427b9596b25f316)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.277181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.330101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8305561ea8814deab427b9596b25f316', 'request_id': 'req-204296fa-a299-4488-a104-3cf2fc5a8590'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.337572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8305561ea8814deab427b9596b25f316', 'request_id': 'req-204296fa-a299-4488-a104-3cf2fc5a8590'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.341530 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:36.347152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8305561ea8814deab427b9596b25f316', 'request_id': 'req-204296fa-a299-4488-a104-3cf2fc5a8590'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.359653 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] The token cache is being invalidate because project 8305561ea8814deab427b9596b25f316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:36.359963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.360630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-204296fa-a299-4488-a104-3cf2fc5a8590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.362181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1249/2501] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:36 2022] DELETE /identity/v3/projects/8305561ea8814deab427b9596b25f316 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:36.367640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.367931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.368201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.390086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:36.391382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.457321 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1253/2502] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:36.467308 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.467619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.467919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.487847 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:36.489061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.498324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1250/2503] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:36.506128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.518602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1029fda-1fe3-4c70-b3fc-738d7aea9adc None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.524862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.526251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.532608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.533554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.534312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.534683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.535716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:36.536260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.538094 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.546730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f9471-6111-4d31-8643-6f8ce877951a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.553553 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.554233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.554505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.554767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] PATH_INFO: `/v3/projects/1eec7e3c52cb44f68562b177633c44b9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.556007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eec7e3c52cb44f68562b177633c44b9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.558067 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1254/2504] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:36.562761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.564945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.579266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f56a-1fec-4ac4-a01d-84ff23b2e588 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.585553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.586316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.586720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.586999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.588655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.590757 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.629463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1255/2505] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:36 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:36.633555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.647551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eec7e3c52cb44f68562b177633c44b9', 'request_id': 'req-d788b231-7823-434b-9109-b67a21111667'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.654481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eec7e3c52cb44f68562b177633c44b9', 'request_id': 'req-d788b231-7823-434b-9109-b67a21111667'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.665319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eec7e3c52cb44f68562b177633c44b9', 'request_id': 'req-d788b231-7823-434b-9109-b67a21111667'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.685812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] The token cache is being invalidate because project 1eec7e3c52cb44f68562b177633c44b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:36.687480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.689464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.691753 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1251/2506] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:36 2022] DELETE /identity/v3/projects/1eec7e3c52cb44f68562b177633c44b9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:36.696094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.700058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.753793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18707d0-93b5-4697-82f3-433c44124cb1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.762119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.762743 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.763060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.763333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.763965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.766253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.803109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b231-7823-434b-9109-b67a21111667 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.810087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.810830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1256/2507] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:36 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:36.813975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.815644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.816534 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.817023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] PATH_INFO: `/v3/users/ad49c0f330384d7eae44060b097c6baa` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.818113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:36.821328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad49c0f330384d7eae44060b097c6baa)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.825681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.834967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47dcd-f5b2-4387-b557-643ef413fbc5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.847082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.847082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.847082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.847082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.847559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.850479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.887272 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1257/2508] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:36.891028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.903249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0fd2d-a585-4f03-ab9c-75e879ca8727 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.910386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.911911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.912665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.913287 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.913418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad49c0f330384d7eae44060b097c6baa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.914280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.917490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.923232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad49c0f330384d7eae44060b097c6baa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.923870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad49c0f330384d7eae44060b097c6baa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.931986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1258/2509] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:36.935912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:36.938253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.943652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad49c0f330384d7eae44060b097c6baa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.945018 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-46e2dcf4-88a1-444e-9ad0-2fbe602089d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad49c0f330384d7eae44060b097c6baa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:36.951686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b2e2-e53f-42c0-8d15-0b00216de205 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.961801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.963006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.963006 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.963988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] PATH_INFO: `/v3/projects/0efc951d9b4c4ddb85d37c9583489357/users/94b4807d53b44a6a826217243657db4d/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.967339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1252/2510] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:36 2022] DELETE /identity/v3/users/ad49c0f330384d7eae44060b097c6baa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:36.990614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efc951d9b4c4ddb85d37c9583489357, user_id=94b4807d53b44a6a826217243657db4d, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.994873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.999523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:37.023714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1259/2511] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:36 2022] PUT /identity/v3/projects/0efc951d9b4c4ddb85d37c9583489357/users/94b4807d53b44a6a826217243657db4d/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:37.035069 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.035698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.035971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.071087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] MFA Rules not processed for user `94b4807d53b44a6a826217243657db4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:37.072363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.157596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1253/2512] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:37.162160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.163899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.242212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a52ea-0ded-4ca3-b231-42a982feee7b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.247578 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.248895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.249173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.249439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.250116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.252034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.284226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.286330 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.290985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1260/2513] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:37.292125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.308992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ec690-4faf-440e-8f98-fddbf93958ea None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.370780 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ffef9-727f-4bc6-bf03-effa57a87ff9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.376206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.376456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.377074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.377197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.377470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.377648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.377869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] PATH_INFO: `/v3/projects/f4d8289ccdd34d7cb165a469bd302cdc` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.378072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.378846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.379772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d8289ccdd34d7cb165a469bd302cdc)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.380933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.382013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.405862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1261/2514] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:37.409551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.424091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29a4d-b792-464d-ba39-fce19616280a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.438020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d8289ccdd34d7cb165a469bd302cdc', 'request_id': 'req-22b5011c-8772-47d1-88e8-10b9d28d1612'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:37.445027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d8289ccdd34d7cb165a469bd302cdc', 'request_id': 'req-22b5011c-8772-47d1-88e8-10b9d28d1612'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:37.457171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d8289ccdd34d7cb165a469bd302cdc', 'request_id': 'req-22b5011c-8772-47d1-88e8-10b9d28d1612'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:37.470472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] The token cache is being invalidate because project f4d8289ccdd34d7cb165a469bd302cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:37.470663 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:37.471672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-22b5011c-8772-47d1-88e8-10b9d28d1612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:37.476702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1254/2515] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:37 2022] DELETE /identity/v3/projects/f4d8289ccdd34d7cb165a469bd302cdc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:37.478492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c21bee-824a-4c23-bf21-5ac0718713d5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.479281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c21bee-824a-4c23-bf21-5ac0718713d5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.479557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c21bee-824a-4c23-bf21-5ac0718713d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.491120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:37.497292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.498033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.498723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.499033 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.499870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.502366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.506585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d3c21bee-824a-4c23-bf21-5ac0718713d5 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:37.510497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d3c21bee-824a-4c23-bf21-5ac0718713d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.513629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1262/2516] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:37.517825 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.519704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.529013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:37.533826 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1255/2517] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:37.533994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9406dd2-f235-469d-ab24-80a7fe8a7471 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.538673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.539166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.539610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.543107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.543913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.544289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.544656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] PATH_INFO: `/v3/projects/a38b10f59e354c1a991a9e1ba6daae91/users/13a1bf975fa5467ebfd707d3f4eca1ea/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.560754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:37.562652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.570625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38b10f59e354c1a991a9e1ba6daae91, user_id=13a1bf975fa5467ebfd707d3f4eca1ea, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.574565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.576341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1256/2518] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:37.577555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.587860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b2a08-ae14-448e-8c01-125ae9c7fc74 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.589517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1263/2519] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:37 2022] PUT /identity/v3/projects/a38b10f59e354c1a991a9e1ba6daae91/users/13a1bf975fa5467ebfd707d3f4eca1ea/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:37.593697 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.652079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.652687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.652924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.653108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.659231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:37.659575 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.661225 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.667500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31448f-efe5-49e7-b8e7-ef39cddefe2e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.673480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1257/2520] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:37.673900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.674778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.675057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.675329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.675968 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.677873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.678008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.690432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebfe06-bd8d-47f5-bc33-afa56657d08e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.694165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1264/2521] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:37.695689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.698727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.699347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.699635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.699893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.700526 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.702660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.707594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173e3a-27ab-4c74-a6f1-18bca7f0e8af admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.713014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21a9d1-63c3-4163-bed0-7c08ed8bd1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.713675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21a9d1-63c3-4163-bed0-7c08ed8bd1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.714025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21a9d1-63c3-4163-bed0-7c08ed8bd1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.714297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21a9d1-63c3-4163-bed0-7c08ed8bd1c7 admin admin] PATH_INFO: `/v3/projects/a38b10f59e354c1a991a9e1ba6daae91/users/13a1bf975fa5467ebfd707d3f4eca1ea/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.716426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21a9d1-63c3-4163-bed0-7c08ed8bd1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38b10f59e354c1a991a9e1ba6daae91, user_id=13a1bf975fa5467ebfd707d3f4eca1ea, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.719884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21a9d1-63c3-4163-bed0-7c08ed8bd1c7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.735780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1258/2522] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:37.735980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1265/2523] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:37 2022] PUT /identity/v3/projects/a38b10f59e354c1a991a9e1ba6daae91/users/13a1bf975fa5467ebfd707d3f4eca1ea/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:37.738992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.743960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.744312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.745162 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.776050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] MFA Rules not processed for user `13a1bf975fa5467ebfd707d3f4eca1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:37.776406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.839890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0be51-2bf4-4118-b240-3cf273d640b2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.852518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.853748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.854184 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.854503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.855401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.858107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.866879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1266/2524] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:37.880619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.880619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.888394 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1259/2525] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:37 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:37.892371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.904438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c449466-18be-4415-b57f-866dcd524ad0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.911672 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.912411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.912692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.913029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.913687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.915459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.927669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1260/2526] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:37.931421 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.942748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660af17-de16-4bad-a2a7-72035b363e54 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.943249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:37.947849 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c96d5d-e67f-4bc1-9685-a2dd043864ff None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.951265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.951925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.952207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.952508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.953858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:37.954279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.954907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:37.955542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.956349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.956752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:37.958991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:37.969808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1261/2527] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:37.972893 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:37.982913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad855-7af4-4d32-beb6-a36d2549d48d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:37.987602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99615fd-eb6a-44f0-97ec-a7e3699f94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:37.988287 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99615fd-eb6a-44f0-97ec-a7e3699f94d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:37.988563 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99615fd-eb6a-44f0-97ec-a7e3699f94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:37.988834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99615fd-eb6a-44f0-97ec-a7e3699f94d6 admin admin] PATH_INFO: `/v3/projects/8990538591e54b05a9bd49649a2f15a7/users/3bb6561eae9d4aebbe29ac82a9fad333/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.005141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99615fd-eb6a-44f0-97ec-a7e3699f94d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8990538591e54b05a9bd49649a2f15a7, user_id=3bb6561eae9d4aebbe29ac82a9fad333, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.007907 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99615fd-eb6a-44f0-97ec-a7e3699f94d6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.037795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1262/2528] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:37 2022] PUT /identity/v3/projects/8990538591e54b05a9bd49649a2f15a7/users/3bb6561eae9d4aebbe29ac82a9fad333/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:38.038038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.038038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.042947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.043272 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.043547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.046796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1267/2529] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:38.056105 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:38.089167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] MFA Rules not processed for user `3bb6561eae9d4aebbe29ac82a9fad333`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:38.090469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:38.176019 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1263/2530] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:38.181246 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.193762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f52f63-d1c3-4502-a37a-34c68ee1ceed service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:38.263795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:38.264487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.265167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.265498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.266274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.269111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.313106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1268/2531] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:38 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:38.314415 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.328277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379619e-04a8-4111-a866-5c1400b7264d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:38.404153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:38.404975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.405331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.405700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.406451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.408548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.440796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.441897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1264/2532] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:38 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:38.467463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b329db-e114-4cce-943e-dd55ad166371 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:38.473199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:38.474739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.475093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.475556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.476148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.478008 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.494500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1269/2533] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:38.496825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.508510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9c87-c38d-4c13-936d-7e18aa20f6af admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:38.516077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:38.516751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.517089 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.517366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] PATH_INFO: `/v3/projects/759bc86f0685479a9945d3931c1704d8/users/b49f897fe2cf4ba381737d2d6d64bd1b/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.544284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=759bc86f0685479a9945d3931c1704d8, user_id=b49f897fe2cf4ba381737d2d6d64bd1b, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.548442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.565416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1265/2534] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:38 2022] PUT /identity/v3/projects/759bc86f0685479a9945d3931c1704d8/users/b49f897fe2cf4ba381737d2d6d64bd1b/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:38.569156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.579937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ea33-f929-423e-97d8-2c23d83577ee admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:38.639127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267673e9-5eea-453b-b9b8-5ee7bd510437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:38.639876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267673e9-5eea-453b-b9b8-5ee7bd510437 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.640215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267673e9-5eea-453b-b9b8-5ee7bd510437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.640569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267673e9-5eea-453b-b9b8-5ee7bd510437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.641310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267673e9-5eea-453b-b9b8-5ee7bd510437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.643192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267673e9-5eea-453b-b9b8-5ee7bd510437 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.653505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1270/2535] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:38.657756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.668749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad5f47-eb1e-432c-b8a1-72e81143afbf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:38.674053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:38.674884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.675424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.675555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] PATH_INFO: `/v3/projects/759bc86f0685479a9945d3931c1704d8/users/b49f897fe2cf4ba381737d2d6d64bd1b/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.677630 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=759bc86f0685479a9945d3931c1704d8, user_id=b49f897fe2cf4ba381737d2d6d64bd1b, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:38.680574 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:38.693948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1266/2536] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:38 2022] PUT /identity/v3/projects/759bc86f0685479a9945d3931c1704d8/users/b49f897fe2cf4ba381737d2d6d64bd1b/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:38.705702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:38.706023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:38.706314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:38.731440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:38.734382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] MFA Rules not processed for user `b49f897fe2cf4ba381737d2d6d64bd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:38.735813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:38.847944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1271/2537] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:38.848968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:38.851952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:38.998293 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:39.007532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832158c4-28e3-4cb0-ac2b-81680a56f38e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:39.012932 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9e1f8-68fb-47aa-8661-d8289e123a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:39.013599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9e1f8-68fb-47aa-8661-d8289e123a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:39.013908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9e1f8-68fb-47aa-8661-d8289e123a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:39.014646 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9e1f8-68fb-47aa-8661-d8289e123a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:39.030730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9e1f8-68fb-47aa-8661-d8289e123a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:39.035388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9e1f8-68fb-47aa-8661-d8289e123a07 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:39.046192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1267/2538] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:39.096498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:39.107395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195668d6-35e7-4d66-8e8d-3ccb99aed35a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:39.111553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:39.112232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:39.112501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:39.112850 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:39.184619 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:39.186245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:39.197487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1272/2539] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:39.319835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:39.319835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:39.320121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:39.342763 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] MFA Rules not processed for user `cc4e648a859f42a7af9117651759baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:39.344241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:39.419092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1268/2540] 10.222.0.75 () {58 vars in 967 bytes} [Wed Aug 31 11:01:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:39.435939 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:39.437950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:39.558603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ac7a-7075-4982-9192-5d603460828f service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:39.565538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b930c3607b42a5801da45336c9c009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:39.566499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:39.566781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:39.567057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:39.595374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:39.599415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:39.618974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1273/2541] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Aug 31 11:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:42.678897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:42.689453 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed9cd-a3af-4589-b3e9-37333c8ee153 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:42.693486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f142522-6ac2-48a6-8a18-022c635080ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:42.694207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f142522-6ac2-48a6-8a18-022c635080ac service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:42.694436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f142522-6ac2-48a6-8a18-022c635080ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:42.695125 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f142522-6ac2-48a6-8a18-022c635080ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:42.775643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f142522-6ac2-48a6-8a18-022c635080ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:42.777096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f142522-6ac2-48a6-8a18-022c635080ac service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:42.784088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:42.787565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1269/2542] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:42.820790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:42.868481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20dc3-8015-4070-885c-bb09440dba38 service swift] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:42.875394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:42.876050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:42.876318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:42.876588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] PATH_INFO: `/v3/users/3bb6561eae9d4aebbe29ac82a9fad333` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:42.878544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb6561eae9d4aebbe29ac82a9fad333)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:42.880570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:42.934329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb6561eae9d4aebbe29ac82a9fad333'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:42.935249 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb6561eae9d4aebbe29ac82a9fad333'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:42.944558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb6561eae9d4aebbe29ac82a9fad333'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:42.945414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb6561eae9d4aebbe29ac82a9fad333'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:42.957917 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb6561eae9d4aebbe29ac82a9fad333'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:42.974964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1274/2543] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:42 2022] DELETE /identity/v3/users/3bb6561eae9d4aebbe29ac82a9fad333 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:42.977072 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:42.977356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:42.977627 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:42.998208 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:42.999432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:43.075800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1270/2544] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:43.085960 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:43.094851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:43.187752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49fdc-12f5-4a7f-9800-c82ad7bf3110 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:43.191729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:43.192343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:43.192649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:43.193042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:43.205798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:43.205798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:43.221299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1275/2545] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:43.510670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:43.512235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:43.525036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20ba5-e662-464e-a27c-9c500d27a178 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:43.530000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:43.530683 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:43.530956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:43.531253 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] PATH_INFO: `/v3/projects/8990538591e54b05a9bd49649a2f15a7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:43.532349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8990538591e54b05a9bd49649a2f15a7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:43.534307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:43.560692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:43.590168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8990538591e54b05a9bd49649a2f15a7', 'request_id': 'req-bbfaaffb-716e-41e9-8264-4d22a78292f2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.596773 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8990538591e54b05a9bd49649a2f15a7', 'request_id': 'req-bbfaaffb-716e-41e9-8264-4d22a78292f2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.604880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8990538591e54b05a9bd49649a2f15a7', 'request_id': 'req-bbfaaffb-716e-41e9-8264-4d22a78292f2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.615807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] The token cache is being invalidate because project 8990538591e54b05a9bd49649a2f15a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:43.616091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.616723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.618368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1271/2546] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:43 2022] DELETE /identity/v3/projects/8990538591e54b05a9bd49649a2f15a7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:43.622965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:43.634354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d690-9553-4ca3-80fa-7adbf14e0a05 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:43.682134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:43.695900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:43.696563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:43.696838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:43.697095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] PATH_INFO: `/v3/users/b49f897fe2cf4ba381737d2d6d64bd1b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:43.698245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49f897fe2cf4ba381737d2d6d64bd1b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:43.700250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:43.751531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49f897fe2cf4ba381737d2d6d64bd1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.752116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49f897fe2cf4ba381737d2d6d64bd1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.760844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49f897fe2cf4ba381737d2d6d64bd1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.761464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49f897fe2cf4ba381737d2d6d64bd1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.776342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-66ab0621-0887-4679-89d2-49ea749ac2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49f897fe2cf4ba381737d2d6d64bd1b'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:43.792173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1276/2547] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:43 2022] DELETE /identity/v3/users/b49f897fe2cf4ba381737d2d6d64bd1b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:44.077338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.078981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:44.092438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaaffb-716e-41e9-8264-4d22a78292f2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.158842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.159454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.159735 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.160007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] PATH_INFO: `/v3/projects/759bc86f0685479a9945d3931c1704d8` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.161185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759bc86f0685479a9945d3931c1704d8)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.163142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.212040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759bc86f0685479a9945d3931c1704d8', 'request_id': 'req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:44.218237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759bc86f0685479a9945d3931c1704d8', 'request_id': 'req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:44.226388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759bc86f0685479a9945d3931c1704d8', 'request_id': 'req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:44.236800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] The token cache is being invalidate because project 759bc86f0685479a9945d3931c1704d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:44.237210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:44.237869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3dcd5db7-cff8-49db-b51f-e23d4f9d72c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:44.239544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1272/2548] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:44 2022] DELETE /identity/v3/projects/759bc86f0685479a9945d3931c1704d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:44.244779 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.245068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.245817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.272711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:44.274235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:44.352176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1277/2549] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:44.360037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.360324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.360597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.387588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:44.388948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:44.400062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1273/2550] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:44.402900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.413500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928480-1e7e-4d46-9704-c84a05ab394f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.419377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.420038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.420316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.420587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.421310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:44.421648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.423325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.437300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1278/2551] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:44.442432 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.455858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cc034-ff66-468f-8d4a-7aba1cee961a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.474149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.474801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.475231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.475500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.476177 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.478323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.508662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1274/2552] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:44 2022] POST /identity/v3/projects => generated 399 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:44.513257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.524961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f65d0e-233e-49a3-8e97-f6cff0064b89 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.581495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:44.589625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.590369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.591046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.591329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.592262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.594702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.622356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1279/2553] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:44 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:44.626697 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.637101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1bee9-e7fb-48e1-a998-420948dd97f1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.642046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.642641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.642912 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.643180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.643819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.645445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.655528 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1275/2554] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:44.659798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.670379 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b7476-7273-4d5d-a45b-e3be1aa9d0d7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.676029 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc64b7c-5cc0-422f-a316-89d0d788deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.676703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64b7c-5cc0-422f-a316-89d0d788deef admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.677034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64b7c-5cc0-422f-a316-89d0d788deef admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.677406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64b7c-5cc0-422f-a316-89d0d788deef admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.678121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc64b7c-5cc0-422f-a316-89d0d788deef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.680040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc64b7c-5cc0-422f-a316-89d0d788deef admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.691793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1280/2555] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:44.696264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.701427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:44.709194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a100-62c2-4232-a3df-3717f25e1bb5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:44.715582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:44.716240 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.716516 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.716788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] PATH_INFO: `/v3/projects/d52cb9ca21584151a7bfbda98861ea04/users/ef67b8ff763741418c4dc0c920551e23/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.733862 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52cb9ca21584151a7bfbda98861ea04, user_id=ef67b8ff763741418c4dc0c920551e23, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:44.736542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:44.750451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1276/2556] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:44 2022] PUT /identity/v3/projects/d52cb9ca21584151a7bfbda98861ea04/users/ef67b8ff763741418c4dc0c920551e23/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:44.826300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:44.827009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:44.827009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:44.858624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] MFA Rules not processed for user `ef67b8ff763741418c4dc0c920551e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:44.859946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:44.928208 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1281/2557] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:44.933117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:44.999037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f21a18-d135-4909-9417-f5dff6c7055b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.003936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.004549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.004819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.005063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.005726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.007668 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.036214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1277/2558] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:44 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:45.040512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.051885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dd6a3-425b-4cdc-9a94-c8310ae108a6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.110245 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.110868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.111150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.111612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.112250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.114343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.139387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1282/2559] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:45 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:45.143873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.154772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75a25-d6c1-49a7-b9cb-e7c1476cedb3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.161163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.161764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.162109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.162378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.163015 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.164651 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.179116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1278/2560] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:45.180431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.191348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d82638-f1ff-473e-897e-1106d13c3c8e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.196276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.197026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.197383 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.197722 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] PATH_INFO: `/v3/projects/7a19f41e6424414883811257a24e6d73/users/0ca7e18c00754d4292034e854659edb1/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.213581 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a19f41e6424414883811257a24e6d73, user_id=0ca7e18c00754d4292034e854659edb1, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.216335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.230957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1283/2561] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:45 2022] PUT /identity/v3/projects/7a19f41e6424414883811257a24e6d73/users/0ca7e18c00754d4292034e854659edb1/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:45.239031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.249764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896d438-9f0e-46b6-8ade-90390c71cac0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.305189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43a335-a166-4b2f-861f-32b469c6f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.305871 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43a335-a166-4b2f-861f-32b469c6f9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.306154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43a335-a166-4b2f-861f-32b469c6f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.306425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43a335-a166-4b2f-861f-32b469c6f9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.307070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43a335-a166-4b2f-861f-32b469c6f9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.308708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43a335-a166-4b2f-861f-32b469c6f9ec admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.319285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1279/2562] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:45.323895 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.334476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6201cc9-c87f-45d8-a89d-a85e8a8a83fb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.339564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.340242 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.340530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.340776 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] PATH_INFO: `/v3/projects/7a19f41e6424414883811257a24e6d73/users/0ca7e18c00754d4292034e854659edb1/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.342946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a19f41e6424414883811257a24e6d73, user_id=0ca7e18c00754d4292034e854659edb1, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.345642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.356934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1284/2563] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:45 2022] PUT /identity/v3/projects/7a19f41e6424414883811257a24e6d73/users/0ca7e18c00754d4292034e854659edb1/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:45.367681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.367969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.368252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.396134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] MFA Rules not processed for user `0ca7e18c00754d4292034e854659edb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:45.397405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:45.442801 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:45.476155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1280/2564] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:45.487781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.489734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:45.512288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:45.558221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cca4da-e6cc-4ac4-b1f6-fa661b884eb1 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.562361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.563034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.563309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.563629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.573443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.575133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.585248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1285/2565] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:45.669913 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.682194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38de88-639a-4a0a-acca-0d401c35119f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.686031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.687091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.687512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.687963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.692262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:45.694031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:45.751684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.752429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4ffc6-939d-4c13-ae81-d3c13e106094 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:45.753202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.756151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:45.756760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:45.757032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:45.757301 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:45.759049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:45.762463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1281/2566] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:45.830224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:45.831638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb93b4d-2afb-4555-bbf0-1da7020a0783 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:45.845021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1286/2567] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:47.771822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:47.773515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:47.789975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05723f2-5e8b-4867-ba74-dd4263fd61ee service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:47.795512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:47.796289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:47.796660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:47.797017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] PATH_INFO: `/v3/users/94b4807d53b44a6a826217243657db4d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:47.798383 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b4807d53b44a6a826217243657db4d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:47.800474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:47.865977 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b4807d53b44a6a826217243657db4d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:47.879467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b4807d53b44a6a826217243657db4d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:47.880098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b4807d53b44a6a826217243657db4d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:47.898314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b4807d53b44a6a826217243657db4d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:47.899063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b4807d53b44a6a826217243657db4d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:47.922189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1282/2568] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:47 2022] DELETE /identity/v3/users/94b4807d53b44a6a826217243657db4d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:47.923908 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:47.924645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:47.924943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:47.944421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:47.945760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:48.006696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1287/2569] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:48.019507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:48.020972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:48.069486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:48.081996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b2b35-497b-4fb0-882a-fa3ab0bd8319 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:48.087091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:48.088073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:48.088362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:48.088622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:48.098031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:48.099463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:48.110117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1283/2570] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:48.488054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:48.489524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:48.505563 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc755e4-e8ff-4c3c-aff3-50a4bf91825a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:48.512117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:48.512720 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:48.513723 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:48.514053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] PATH_INFO: `/v3/projects/0efc951d9b4c4ddb85d37c9583489357` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:48.515837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efc951d9b4c4ddb85d37c9583489357)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:48.517875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:48.520934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:48.581148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efc951d9b4c4ddb85d37c9583489357', 'request_id': 'req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.588345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efc951d9b4c4ddb85d37c9583489357', 'request_id': 'req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.600600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efc951d9b4c4ddb85d37c9583489357', 'request_id': 'req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.616215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] The token cache is being invalidate because project 0efc951d9b4c4ddb85d37c9583489357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:48.616215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.618101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.619711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1288/2571] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:48 2022] DELETE /identity/v3/projects/0efc951d9b4c4ddb85d37c9583489357 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:48.623879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:48.636498 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06cc2f-e97e-44a2-b908-d6fef15e0c11 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:48.773029 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:48.773870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:48.774039 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:48.774480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] PATH_INFO: `/v3/users/13a1bf975fa5467ebfd707d3f4eca1ea` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:48.775777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a1bf975fa5467ebfd707d3f4eca1ea)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:48.778506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:48.858000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a1bf975fa5467ebfd707d3f4eca1ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.872157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a1bf975fa5467ebfd707d3f4eca1ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.873662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a1bf975fa5467ebfd707d3f4eca1ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.896244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a1bf975fa5467ebfd707d3f4eca1ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.897986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0bfa3775-85da-45a9-b6b1-a8a41741d1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a1bf975fa5467ebfd707d3f4eca1ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:48.934180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1284/2572] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:48 2022] DELETE /identity/v3/users/13a1bf975fa5467ebfd707d3f4eca1ea => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:49.424756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:49.426767 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:49.440622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b926666-5843-4c9f-a2ff-0ad1bfe6ee7d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:49.518969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:49.520382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.520808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.521440 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] PATH_INFO: `/v3/projects/a38b10f59e354c1a991a9e1ba6daae91` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.523105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38b10f59e354c1a991a9e1ba6daae91)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:49.526080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:49.583259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38b10f59e354c1a991a9e1ba6daae91', 'request_id': 'req-654fd04d-9952-4c67-bf3a-c316c2f62aa6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.589613 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38b10f59e354c1a991a9e1ba6daae91', 'request_id': 'req-654fd04d-9952-4c67-bf3a-c316c2f62aa6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.598765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38b10f59e354c1a991a9e1ba6daae91', 'request_id': 'req-654fd04d-9952-4c67-bf3a-c316c2f62aa6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.611485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] The token cache is being invalidate because project a38b10f59e354c1a991a9e1ba6daae91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:49.611862 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.612646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-654fd04d-9952-4c67-bf3a-c316c2f62aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.614961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1289/2573] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:49 2022] DELETE /identity/v3/projects/a38b10f59e354c1a991a9e1ba6daae91 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:49.620924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.621230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.621495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.641867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:49.643083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:49.707051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1285/2574] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:49.715957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.716236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.716505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.736390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:49.737597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:49.749111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1290/2575] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:49.751188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:49.762577 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f1061-4b2a-4f15-bb71-4b7cd9fa9b80 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:49.768242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:49.768928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.769206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.769477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.770191 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:49.770492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:49.772112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:49.774611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:49.790485 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1286/2576] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:49.791455 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:49.801291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31c92e-5a79-4ec2-a2e2-f771f171b60a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:49.806432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:49.807232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.807658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.808100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.809050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:49.811595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:49.828069 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:49.840048 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:49.842457 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:49.844218 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1291/2577] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:49 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:49.849091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:49.862000 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744b4cc-7be8-4da5-b631-bff96d8de917 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:49.912876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae8b66-bc49-4186-9633-7097fedbfbf8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:49.917155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:49.917708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:49.919603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.919603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.919603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] PATH_INFO: `/v3/users/73f1b9e32ad3493284c5df45afd042fa` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.919892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.919892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.919892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.920144 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f1b9e32ad3493284c5df45afd042fa)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:49.921731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:49.925941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:49.928935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:49.971149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1292/2578] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:49 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:49.972565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:49.973568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f1b9e32ad3493284c5df45afd042fa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.983283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f1b9e32ad3493284c5df45afd042fa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.983737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703f62-957c-4887-aa92-2da4be136982 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:49.984001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f1b9e32ad3493284c5df45afd042fa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:49.988683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:49.989311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:49.989643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:49.989934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:49.990580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:49.992541 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.002649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f1b9e32ad3493284c5df45afd042fa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.003458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f1b9e32ad3493284c5df45afd042fa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.007438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1293/2579] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:50.009001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.010883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.020712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1287/2580] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:49 2022] DELETE /identity/v3/users/73f1b9e32ad3493284c5df45afd042fa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:50.026241 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29aeb8-fc55-462d-9bd1-737ef08f055a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.093678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.095231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.095522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.095844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.096607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.098587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.113483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1294/2581] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:50.116020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.116679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.118488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.128919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4efda-74a7-4622-894e-c04287c3c8ef admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.132641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67176f-b269-49bb-b59b-41b71a67440c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.134813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4137f-9832-4cd1-bcbd-1f7abfc0a919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.135555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4137f-9832-4cd1-bcbd-1f7abfc0a919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.136363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4137f-9832-4cd1-bcbd-1f7abfc0a919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.136711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4137f-9832-4cd1-bcbd-1f7abfc0a919 admin admin] PATH_INFO: `/v3/projects/063cd1d65f9c41efb5b8de430b3048db/users/2def287bbf594f139e9d94b28cad4e1e/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.138441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.139461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.139984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.141332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] PATH_INFO: `/v3/users/ef67b8ff763741418c4dc0c920551e23` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.142806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef67b8ff763741418c4dc0c920551e23)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.145403 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.153935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4137f-9832-4cd1-bcbd-1f7abfc0a919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063cd1d65f9c41efb5b8de430b3048db, user_id=2def287bbf594f139e9d94b28cad4e1e, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.156677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4137f-9832-4cd1-bcbd-1f7abfc0a919 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.171963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1295/2582] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:50 2022] PUT /identity/v3/projects/063cd1d65f9c41efb5b8de430b3048db/users/2def287bbf594f139e9d94b28cad4e1e/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:50.188220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62b22-2a4b-4e7b-a67c-597bbdf7a11c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.188991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62b22-2a4b-4e7b-a67c-597bbdf7a11c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.188991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62b22-2a4b-4e7b-a67c-597bbdf7a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.217816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef67b8ff763741418c4dc0c920551e23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.231602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef67b8ff763741418c4dc0c920551e23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.232407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef67b8ff763741418c4dc0c920551e23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.235623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-fbd62b22-2a4b-4e7b-a67c-597bbdf7a11c None None] MFA Rules not processed for user `2def287bbf594f139e9d94b28cad4e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:50.237643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fbd62b22-2a4b-4e7b-a67c-597bbdf7a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.253461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:50.256731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef67b8ff763741418c4dc0c920551e23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.257873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef67b8ff763741418c4dc0c920551e23'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.274808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1288/2583] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:50 2022] DELETE /identity/v3/users/ef67b8ff763741418c4dc0c920551e23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:50.275694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.277063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.279319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:50.329934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1296/2584] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:50.332499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.332784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.333055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.356516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:50.356962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023246-f217-4903-a3c2-10075c3fa077 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.357925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.362395 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.363802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.364093 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.364352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] PATH_INFO: `/v3/projects/7c3039f002ef448b99d4e7f484055fd7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.365552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3039f002ef448b99d4e7f484055fd7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.366553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1297/2585] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:50.367269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.367681 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.368793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.429379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3039f002ef448b99d4e7f484055fd7', 'request_id': 'req-5bb3aace-f966-49de-98d8-fb52bc14e93c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.434312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782a83-2d95-46c1-b3b1-345211c98639 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.435964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3039f002ef448b99d4e7f484055fd7', 'request_id': 'req-5bb3aace-f966-49de-98d8-fb52bc14e93c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.446747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3039f002ef448b99d4e7f484055fd7', 'request_id': 'req-5bb3aace-f966-49de-98d8-fb52bc14e93c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.459721 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] The token cache is being invalidate because project 7c3039f002ef448b99d4e7f484055fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:50.460014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.460744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.462599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1289/2586] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:50 2022] DELETE /identity/v3/projects/7c3039f002ef448b99d4e7f484055fd7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:50.467677 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.470353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.489318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.489981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.490742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.490742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.492335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.538841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3aace-f966-49de-98d8-fb52bc14e93c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.542375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.542983 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.543261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.543532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.545304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.555038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.556538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59552d8-ef8a-48ce-a723-747a00d8b9d3 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.566307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1298/2587] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:50.567950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8a853-9e2f-4f6e-9dad-f254ffbf4ef8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.568781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8a853-9e2f-4f6e-9dad-f254ffbf4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.568781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8a853-9e2f-4f6e-9dad-f254ffbf4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.587729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:50.589259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-8dc8a853-9e2f-4f6e-9dad-f254ffbf4ef8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:50.590643 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8dc8a853-9e2f-4f6e-9dad-f254ffbf4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.622635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.624042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:50.624180 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.633742 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1290/2588] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:50.634576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.635926 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.647733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec3cc-728e-4e10-956c-99a74c3cf993 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.652479 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.653260 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.653541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.653837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] PATH_INFO: `/v3/users/2def287bbf594f139e9d94b28cad4e1e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.655141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2def287bbf594f139e9d94b28cad4e1e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.656956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.668174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1299/2589] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:50.676131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.676512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.676846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.708066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:50.709900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.718087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2def287bbf594f139e9d94b28cad4e1e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.723420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1300/2590] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:50.724979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.731345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2def287bbf594f139e9d94b28cad4e1e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.732611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2def287bbf594f139e9d94b28cad4e1e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.736366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef24a28-b774-4f8c-9a91-116024e46727 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.741165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.741801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.742082 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.742372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.743002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:50.743306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.745005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.747248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2def287bbf594f139e9d94b28cad4e1e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.749286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8697dc7c-a58c-409b-900d-85a2deed0b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2def287bbf594f139e9d94b28cad4e1e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:50.757599 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1301/2591] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:50.762102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.763591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1291/2592] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:50 2022] DELETE /identity/v3/users/2def287bbf594f139e9d94b28cad4e1e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:50.766174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.767887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.768301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.768667 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.781012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb870771-3f94-4a04-b0d0-bbcb628c038a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.791784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:50.794374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.849446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.850214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.851092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.851092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.851444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.853400 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.858616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1292/2593] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:50.868439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.871540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:50.890238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1302/2594] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:50.895318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:50.919948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:50.940680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1c015-2f25-4111-90b7-82219756503f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.969209 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447bbbd-ebb0-474e-ab6a-6aa3c9075c2c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:50.974247 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.975064 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.975346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.975617 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:50.976286 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:50.978237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:50.995361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:50.996099 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:50.996382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:50.996642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.002183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1303/2595] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:50 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:51.006296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.006716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.007928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.008194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.018599 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1293/2596] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:51.019312 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.027733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ddcb-1f41-42fc-bd61-dc0d2cf29257 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.028691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf744926-9f59-4a63-b8d1-1c564d781b85 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.033275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.033416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.034012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.034294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.034556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.035127 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.035274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.036354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.037117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.037381 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] PATH_INFO: `/v3/projects/d52cb9ca21584151a7bfbda98861ea04` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.039075 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52cb9ca21584151a7bfbda98861ea04)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.041349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.046940 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1294/2597] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:51.051059 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.061450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcc477-0b5c-46df-a7dd-8dd9216e2a52 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.066659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.067306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.067536 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.067806 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.068596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.070342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.080915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1295/2598] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:51.085448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.085759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:51.096431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e979-3352-4697-aea0-fb5e198dbd51 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.101445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8af52e-6a03-4248-b401-afdc7e4cca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.102261 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8af52e-6a03-4248-b401-afdc7e4cca14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.102642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8af52e-6a03-4248-b401-afdc7e4cca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.103007 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8af52e-6a03-4248-b401-afdc7e4cca14 admin admin] PATH_INFO: `/v3/projects/a9035e98360242c49fc775ad755f50b5/users/9a3e4611f27b46819597e29f3a6b5728/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.119110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8af52e-6a03-4248-b401-afdc7e4cca14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9035e98360242c49fc775ad755f50b5, user_id=9a3e4611f27b46819597e29f3a6b5728, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.120558 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52cb9ca21584151a7bfbda98861ea04', 'request_id': 'req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.121997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8af52e-6a03-4248-b401-afdc7e4cca14 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.128704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52cb9ca21584151a7bfbda98861ea04', 'request_id': 'req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.137093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52cb9ca21584151a7bfbda98861ea04', 'request_id': 'req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.138497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1296/2599] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:51 2022] PUT /identity/v3/projects/a9035e98360242c49fc775ad755f50b5/users/9a3e4611f27b46819597e29f3a6b5728/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:51.149195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.149556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.150062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.150285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] The token cache is being invalidate because project d52cb9ca21584151a7bfbda98861ea04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:51.150729 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.151530 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.153524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1304/2600] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:51 2022] DELETE /identity/v3/projects/d52cb9ca21584151a7bfbda98861ea04 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:51.157626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.160854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.183690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] MFA Rules not processed for user `9a3e4611f27b46819597e29f3a6b5728`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:51.185639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.236848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced7cc-bdc5-46f4-91cf-c2b1646aece8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.290473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1297/2601] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:51.295182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.296660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.301038 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.301882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.302232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.302611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] PATH_INFO: `/v3/users/0ca7e18c00754d4292034e854659edb1` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.304227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca7e18c00754d4292034e854659edb1)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.307836 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.311378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd30751-0be0-49be-a656-a21769f1f5fe None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.318053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.318434 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.318710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.318982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.321603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.323435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.365650 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1298/2602] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:51 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:51.366557 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.368141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.373221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca7e18c00754d4292034e854659edb1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.374152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca7e18c00754d4292034e854659edb1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.383201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca7e18c00754d4292034e854659edb1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.383868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca7e18c00754d4292034e854659edb1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.388210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:51.393140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:51.399384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca7e18c00754d4292034e854659edb1'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.412336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1305/2603] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:51 2022] DELETE /identity/v3/users/0ca7e18c00754d4292034e854659edb1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:51.414816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.423061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.438399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe56fc0-6bc8-4f21-9161-55fbe10c84a4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.493903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed7088-2f0c-4fee-8b1d-443c17b96ea9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.502406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.503481 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.503962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.504595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.505331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.507837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.513764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.514547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.515043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.515517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] PATH_INFO: `/v3/projects/063cd1d65f9c41efb5b8de430b3048db` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.531268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=063cd1d65f9c41efb5b8de430b3048db)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.532910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1306/2604] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:51 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:51.536918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.537366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.549034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ca3fc-1775-4d0c-8038-511e41af945f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.554661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.555325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.555689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.556074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.556956 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.558778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.572150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1307/2605] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:51.575962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.589118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38022-efe2-48f4-8a41-adb5bc0f1358 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.596117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.597496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.598450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.598903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] PATH_INFO: `/v3/projects/7dfa019e083c438eadfc87e9d7b794c6/users/59330fb1aec74707a7f685e9714606a9/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.619787 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfa019e083c438eadfc87e9d7b794c6, user_id=59330fb1aec74707a7f685e9714606a9, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.624486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.634241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063cd1d65f9c41efb5b8de430b3048db', 'request_id': 'req-089e46e8-ebc2-4840-b1dc-184808c71e8e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.641824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063cd1d65f9c41efb5b8de430b3048db', 'request_id': 'req-089e46e8-ebc2-4840-b1dc-184808c71e8e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.643221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1308/2606] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:51 2022] PUT /identity/v3/projects/7dfa019e083c438eadfc87e9d7b794c6/users/59330fb1aec74707a7f685e9714606a9/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:51.648115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.651926 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063cd1d65f9c41efb5b8de430b3048db', 'request_id': 'req-089e46e8-ebc2-4840-b1dc-184808c71e8e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.667411 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] The token cache is being invalidate because project 063cd1d65f9c41efb5b8de430b3048db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:51.667899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.668756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-089e46e8-ebc2-4840-b1dc-184808c71e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.671045 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1299/2607] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:51 2022] DELETE /identity/v3/projects/063cd1d65f9c41efb5b8de430b3048db => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:51.678654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.679084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.679431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.714446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:51.714446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.732610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78022-3b9a-4d5b-acff-3548f0f1eea6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.737610 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.738255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.738535 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.738809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.739474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.741091 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.752811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1309/2608] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:51.756986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.759548 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.765003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:51.776485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17acf-d7e9-42e0-bb38-25abb2b0f21f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.781815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1300/2609] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:01:51.782669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.782806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833a86b-f978-4c4b-9817-21539e4efeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.783498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a86b-f978-4c4b-9817-21539e4efeee admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.783778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a86b-f978-4c4b-9817-21539e4efeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.783966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.784055 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a86b-f978-4c4b-9817-21539e4efeee admin admin] PATH_INFO: `/v3/projects/7dfa019e083c438eadfc87e9d7b794c6/users/59330fb1aec74707a7f685e9714606a9/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.786529 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833a86b-f978-4c4b-9817-21539e4efeee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfa019e083c438eadfc87e9d7b794c6, user_id=59330fb1aec74707a7f685e9714606a9, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.789382 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833a86b-f978-4c4b-9817-21539e4efeee admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.797036 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3540-35e2-401d-abf2-46cde0630ef4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:51.812790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1310/2610] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:51 2022] PUT /identity/v3/projects/7dfa019e083c438eadfc87e9d7b794c6/users/59330fb1aec74707a7f685e9714606a9/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:51.812790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9ff4-4673-4728-8dfa-93d0b03a07cd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.812790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9ff4-4673-4728-8dfa-93d0b03a07cd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.812790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9ff4-4673-4728-8dfa-93d0b03a07cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.827086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-d67b9ff4-4673-4728-8dfa-93d0b03a07cd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:51.828490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d67b9ff4-4673-4728-8dfa-93d0b03a07cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.842141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:51.882740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:51.883502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.883841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.884117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] PATH_INFO: `/v3/projects/7a19f41e6424414883811257a24e6d73` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.885328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a19f41e6424414883811257a24e6d73)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:51.887284 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:51.895180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1311/2611] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:51.897046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:51.897336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:51.897611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:51.926032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] MFA Rules not processed for user `59330fb1aec74707a7f685e9714606a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:51.927505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:51.934138 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a19f41e6424414883811257a24e6d73', 'request_id': 'req-f8723ed8-0c39-46c0-be6a-d651d3814ef8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.940724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a19f41e6424414883811257a24e6d73', 'request_id': 'req-f8723ed8-0c39-46c0-be6a-d651d3814ef8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.949598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a19f41e6424414883811257a24e6d73', 'request_id': 'req-f8723ed8-0c39-46c0-be6a-d651d3814ef8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.960349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] The token cache is being invalidate because project 7a19f41e6424414883811257a24e6d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:51.960349 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.960877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:51.962414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1301/2612] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:51 2022] DELETE /identity/v3/projects/7a19f41e6424414883811257a24e6d73 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:51.963170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:51.964417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.021699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1312/2613] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:52.037644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.039721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.052305 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8723ed8-0c39-46c0-be6a-d651d3814ef8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.058274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.059081 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.059501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.059817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.061097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:52.061588 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.065121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.081876 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1302/2614] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:52.086566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.099151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0d14c-f6c8-4b8c-814f-44c0c83f4901 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.104348 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.104972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.105247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.105515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.106210 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.108152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.110596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f21d-a39b-4ab2-b965-d0baca0fb923 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.115183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.115832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.116111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.116531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.129189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.130709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.133750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:52.142347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1313/2615] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:52.146975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1303/2616] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:52 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:52.149583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.160806 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c2b9-3544-480b-a720-5d3b3734f2e2 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.217886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:52.237009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.237009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.237009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.237009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.237360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.238970 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.263582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1314/2617] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:52 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:52.264914 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.278034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acabe83-2181-4afa-9683-e949bbfa16d4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.282732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.283341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.283616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.283883 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.284519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.286808 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.302197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1304/2618] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:52.303755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.314910 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7e39-d414-4ace-947a-d67eb84c7424 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.320570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4f8d-1994-46f0-9520-2289d8add562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.321139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4f8d-1994-46f0-9520-2289d8add562 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.321412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4f8d-1994-46f0-9520-2289d8add562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.321817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4f8d-1994-46f0-9520-2289d8add562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.322386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4f8d-1994-46f0-9520-2289d8add562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.327973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4f8d-1994-46f0-9520-2289d8add562 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.341056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1315/2619] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:52.342361 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.352884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd2e3-c15a-4d86-aaba-aaf3b2d14043 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.361724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.362424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.362698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.362974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] PATH_INFO: `/v3/projects/13d4a6bd95ab441fb11537c5f4784b4e/users/18a10c05f84641fd8628bf32938e063f/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.378853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4a6bd95ab441fb11537c5f4784b4e, user_id=18a10c05f84641fd8628bf32938e063f, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.381662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.396865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1305/2620] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:52 2022] PUT /identity/v3/projects/13d4a6bd95ab441fb11537c5f4784b4e/users/18a10c05f84641fd8628bf32938e063f/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:52.409754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.409754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.409754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.445207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] MFA Rules not processed for user `18a10c05f84641fd8628bf32938e063f`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:52.446522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.517762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1316/2621] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:52.528889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.530865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.573124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.574624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.594965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fee8b-776c-431c-b3b9-3e5d386283e2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.598716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36df49-7195-4d9a-bcec-c1af88afd30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.599320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36df49-7195-4d9a-bcec-c1af88afd30b service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.599597 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36df49-7195-4d9a-bcec-c1af88afd30b service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.599866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36df49-7195-4d9a-bcec-c1af88afd30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.608251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36df49-7195-4d9a-bcec-c1af88afd30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.609713 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36df49-7195-4d9a-bcec-c1af88afd30b service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.618957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1306/2622] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:01:52.644049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455885f3-0234-4b5b-80f2-2c648a7adf47 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.649428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.650088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.650371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.650644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] PATH_INFO: `/v3/users/9a3e4611f27b46819597e29f3a6b5728` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.651885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3e4611f27b46819597e29f3a6b5728)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.653864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.705023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3e4611f27b46819597e29f3a6b5728'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:52.705699 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3e4611f27b46819597e29f3a6b5728'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:52.714310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3e4611f27b46819597e29f3a6b5728'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:52.715185 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3e4611f27b46819597e29f3a6b5728'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:52.719885 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:52.729248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3e4611f27b46819597e29f3a6b5728'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:52.743368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1317/2623] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:52 2022] DELETE /identity/v3/users/9a3e4611f27b46819597e29f3a6b5728 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:52.748517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.748881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.749331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.770897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:52.772144 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.835678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1307/2624] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:52.845846 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:52.847339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:52.918868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a907-8513-47f4-9548-cc38c1e4ea7a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:52.922993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:52.923719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:52.924101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:52.924521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:52.934925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:52.936467 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:52.946354 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1318/2625] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:53.222938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:53.224641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:53.237566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b90d6-e1b1-4f44-996d-7bf01b0bfb54 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:53.242802 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:53.243451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:53.243725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:53.243993 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] PATH_INFO: `/v3/projects/a9035e98360242c49fc775ad755f50b5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:53.245248 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9035e98360242c49fc775ad755f50b5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:53.247207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:53.296020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9035e98360242c49fc775ad755f50b5', 'request_id': 'req-0e65eafb-759d-4c69-9fea-59ff2b6702c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.302311 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9035e98360242c49fc775ad755f50b5', 'request_id': 'req-0e65eafb-759d-4c69-9fea-59ff2b6702c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.312319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9035e98360242c49fc775ad755f50b5', 'request_id': 'req-0e65eafb-759d-4c69-9fea-59ff2b6702c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.313522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:53.325031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] The token cache is being invalidate because project a9035e98360242c49fc775ad755f50b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:53.325327 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.326005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.327706 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1308/2626] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:53 2022] DELETE /identity/v3/projects/a9035e98360242c49fc775ad755f50b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:53.331923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:53.342221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f311a-e2c7-4d2c-bc8f-99af68de50bc service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:53.400345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:53.400979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:53.401256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:53.401531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] PATH_INFO: `/v3/users/59330fb1aec74707a7f685e9714606a9` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:53.402685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59330fb1aec74707a7f685e9714606a9)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:53.404674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:53.453163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59330fb1aec74707a7f685e9714606a9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.453845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59330fb1aec74707a7f685e9714606a9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.462538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59330fb1aec74707a7f685e9714606a9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.463167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59330fb1aec74707a7f685e9714606a9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.476110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-71bd41ab-4a10-4718-9449-551ceca0d59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59330fb1aec74707a7f685e9714606a9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.483539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:53.489685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1319/2627] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:53 2022] DELETE /identity/v3/users/59330fb1aec74707a7f685e9714606a9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:53.772400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:53.774028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:53.789368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65eafb-759d-4c69-9fea-59ff2b6702c0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:53.853120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:53.853761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:53.854070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:53.854339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] PATH_INFO: `/v3/projects/7dfa019e083c438eadfc87e9d7b794c6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:53.855504 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfa019e083c438eadfc87e9d7b794c6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:53.857427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:53.910202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfa019e083c438eadfc87e9d7b794c6', 'request_id': 'req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.916378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfa019e083c438eadfc87e9d7b794c6', 'request_id': 'req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.925041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfa019e083c438eadfc87e9d7b794c6', 'request_id': 'req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.936042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] The token cache is being invalidate because project 7dfa019e083c438eadfc87e9d7b794c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:53.936333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.937317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ee3927b6-7e70-4e35-9bcb-bf4ea1cf7eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:53.938860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1309/2628] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:53 2022] DELETE /identity/v3/projects/7dfa019e083c438eadfc87e9d7b794c6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:53.944376 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:53.944858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:53.945054 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:53.965417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:53.966649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:54.031137 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1320/2629] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:54.038959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.039270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.039548 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.059364 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:54.060572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:54.072860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1310/2630] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:54.074090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.084900 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13348953-9485-49ea-b63e-f1675e0bb823 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.090580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.091196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.091471 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.091741 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.092398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:54.092702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.094491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.106826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1321/2631] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:54.111468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.121967 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6fba7-b7df-4f42-b5dc-2c6e1e3bbce3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.127533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.128182 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.128461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.128731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.129396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.131407 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.166973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1311/2632] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:54.168766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.179916 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a9f4e-d9d5-460a-9c85-a85f7b55c5fe admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.244868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.245506 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.245797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.246124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.246769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.248749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.272408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1322/2633] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:54.276452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.288916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153a49-58fa-450f-b7d5-6d3eab19a9d7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.294968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.295596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.295869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.296192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.296841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.298496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.313306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1312/2634] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:54.314995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.325901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20015a-a156-40c9-8690-9d5e886b0202 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.331607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fdd5e-1bf6-4878-86d6-49e27aff9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.332252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fdd5e-1bf6-4878-86d6-49e27aff9949 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.332536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fdd5e-1bf6-4878-86d6-49e27aff9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.332800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fdd5e-1bf6-4878-86d6-49e27aff9949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.333464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fdd5e-1bf6-4878-86d6-49e27aff9949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.335118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fdd5e-1bf6-4878-86d6-49e27aff9949 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.346684 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1323/2635] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:54.351270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.361754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20af332-c094-4927-9332-62c247e3bef9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.367385 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.368075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.368352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.368616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] PATH_INFO: `/v3/projects/f241634811ba4e5d927edf9ddb596cc4/users/9e11ae5ac8f4474a907ef9b70d1204ae/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.384579 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f241634811ba4e5d927edf9ddb596cc4, user_id=9e11ae5ac8f4474a907ef9b70d1204ae, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.387165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.402887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1313/2636] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:54 2022] PUT /identity/v3/projects/f241634811ba4e5d927edf9ddb596cc4/users/9e11ae5ac8f4474a907ef9b70d1204ae/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:54.413620 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0db13-7325-42cc-af22-182dedca438a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.413943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0db13-7325-42cc-af22-182dedca438a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.414223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0db13-7325-42cc-af22-182dedca438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.442582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-94e0db13-7325-42cc-af22-182dedca438a None None] MFA Rules not processed for user `9e11ae5ac8f4474a907ef9b70d1204ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:54.443930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-94e0db13-7325-42cc-af22-182dedca438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:54.502331 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:54.513689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1324/2637] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:54.518535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.537259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:54.586489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a960b-f310-46da-96aa-ce5cda079aba admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.591956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.592619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.593935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.594266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.595100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.596849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.629628 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1314/2638] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:54.634212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0db13-7325-42cc-af22-182dedca438a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.646686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0db13-7325-42cc-af22-182dedca438a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.703343 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.703954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.704234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.704525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.705139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.707129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.730319 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1325/2639] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:54.736346 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.752108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de433f3-316a-42c3-bb07-2101b1dda800 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.757973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.758582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.758860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.759131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.759805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.761473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.774004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1315/2640] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:54.779214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.789498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f609f-41f7-4dbb-ac1f-0eefda788f77 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.794512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.795143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.795431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.795721 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] PATH_INFO: `/v3/projects/ab4d6e32bffb4f329845db6b7ef309ca/users/f3c0ab09042a472d858bae2772c1bfcd/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.812954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4d6e32bffb4f329845db6b7ef309ca, user_id=f3c0ab09042a472d858bae2772c1bfcd, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.815670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.831216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1326/2641] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:54 2022] PUT /identity/v3/projects/ab4d6e32bffb4f329845db6b7ef309ca/users/f3c0ab09042a472d858bae2772c1bfcd/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:54.835518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.848223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8e085-4e96-418b-be65-87e32714b40f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.906156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274aaa9-4adb-45df-a700-ca7c7fd19bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.906846 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274aaa9-4adb-45df-a700-ca7c7fd19bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.906973 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274aaa9-4adb-45df-a700-ca7c7fd19bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.907190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274aaa9-4adb-45df-a700-ca7c7fd19bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.907814 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274aaa9-4adb-45df-a700-ca7c7fd19bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.909388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274aaa9-4adb-45df-a700-ca7c7fd19bb8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.919338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1316/2642] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:54.923903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:54.935553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096eca-aa51-4099-aca7-ab324974c6ae admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:54.941215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:54.941930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.942212 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.942487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] PATH_INFO: `/v3/projects/ab4d6e32bffb4f329845db6b7ef309ca/users/f3c0ab09042a472d858bae2772c1bfcd/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.944570 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4d6e32bffb4f329845db6b7ef309ca, user_id=f3c0ab09042a472d858bae2772c1bfcd, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:54.947290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:54.958297 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1327/2643] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:54 2022] PUT /identity/v3/projects/ab4d6e32bffb4f329845db6b7ef309ca/users/f3c0ab09042a472d858bae2772c1bfcd/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:54.972995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:54.972995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:54.972995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:54.999595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] MFA Rules not processed for user `f3c0ab09042a472d858bae2772c1bfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:55.000798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:55.071129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1317/2644] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:55.084325 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:55.087186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:55.155073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f347d9-6970-4afe-b3e0-52c3a1b35a27 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:55.159732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:55.160291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:55.160567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:55.160854 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:55.170439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:55.171972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:55.181266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1328/2645] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:55.259709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:55.269712 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82105-5e49-4781-96bb-08a06fedc7aa None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:55.273492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae97d2-530d-4e1a-afe7-853867919305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:55.274124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae97d2-530d-4e1a-afe7-853867919305 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:55.274402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae97d2-530d-4e1a-afe7-853867919305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:55.274670 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae97d2-530d-4e1a-afe7-853867919305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:55.283657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:55.334708 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae97d2-530d-4e1a-afe7-853867919305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:55.336150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae97d2-530d-4e1a-afe7-853867919305 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:55.345363 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1318/2646] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:55.686688 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:55.688704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:55.740373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:55.764706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f828-acb7-410d-ae60-2b7acf327876 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:55.770943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:55.771601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:55.771880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:55.772150 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] PATH_INFO: `/v3/users/18a10c05f84641fd8628bf32938e063f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:55.773413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a10c05f84641fd8628bf32938e063f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:55.775413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:55.838556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a10c05f84641fd8628bf32938e063f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:55.839222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a10c05f84641fd8628bf32938e063f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:55.848853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a10c05f84641fd8628bf32938e063f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:55.849624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a10c05f84641fd8628bf32938e063f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:55.862700 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a10c05f84641fd8628bf32938e063f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:55.874715 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1329/2647] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:01:55 2022] DELETE /identity/v3/users/18a10c05f84641fd8628bf32938e063f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:55.879352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:55.879669 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:55.879950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:55.899674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:55.900919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:55.962691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1319/2648] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:55.973011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:55.974566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:56.034107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97691032-ec29-4ef1-b2da-17a90e2bb0d5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.038324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80575d-dc28-4465-b027-32fd5c01b37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.038948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80575d-dc28-4465-b027-32fd5c01b37f service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.039223 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80575d-dc28-4465-b027-32fd5c01b37f service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.039496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80575d-dc28-4465-b027-32fd5c01b37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.048965 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80575d-dc28-4465-b027-32fd5c01b37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.050463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80575d-dc28-4465-b027-32fd5c01b37f service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.059997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1330/2649] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:56.361170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.362716 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:56.375584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33b0c-7a7e-496c-9cb4-33e548a31f29 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.380757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.381556 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.381934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.382336 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] PATH_INFO: `/v3/projects/13d4a6bd95ab441fb11537c5f4784b4e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.384368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d4a6bd95ab441fb11537c5f4784b4e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.386341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.444064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d4a6bd95ab441fb11537c5f4784b4e', 'request_id': 'req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:56.453957 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d4a6bd95ab441fb11537c5f4784b4e', 'request_id': 'req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:56.463727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d4a6bd95ab441fb11537c5f4784b4e', 'request_id': 'req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:56.475492 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] The token cache is being invalidate because project 13d4a6bd95ab441fb11537c5f4784b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:01:56.475811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:56.476491 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d2f6e674-62e9-42aa-bf0c-3fe174a7109f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:01:56.478076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1320/2650] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:01:56 2022] DELETE /identity/v3/projects/13d4a6bd95ab441fb11537c5f4784b4e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:01:56.483191 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.483474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.483739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.505804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:56.507361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:56.572685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1331/2651] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:56.580785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.581135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.581467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.601858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:56.603230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:56.613971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1321/2652] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:56.616653 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.626504 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e910-a297-4c47-bedf-a7c8da1615b7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.631340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.631972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.632284 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.632551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.633181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:56.633468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.635141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.642235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:56.654067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.654623 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1332/2653] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:56.664214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100118-9218-4e53-ab4f-8b1741ae30b7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.669748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.670458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.670738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.671003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.671693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.673610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.706128 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1322/2654] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:56 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:56.711542 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.722739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602c5fc-0c8f-4bec-9f0d-187eb4db296d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.784070 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.784686 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.784967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.785243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.786009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.788051 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.817355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1333/2655] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:56 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:56.821674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.830508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:56.835033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7d5c-5ebd-4d3a-bb40-6b68bf67f06d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.847685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.848405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.848785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.849178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.849979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.852971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.866938 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1323/2656] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:56.871251 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.882126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30b35-7be1-4ab8-bf97-78ddd045793f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.888198 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172522f-85bf-4840-b9f9-fb2dd40a9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.888816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172522f-85bf-4840-b9f9-fb2dd40a9a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.889194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172522f-85bf-4840-b9f9-fb2dd40a9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.889616 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172522f-85bf-4840-b9f9-fb2dd40a9a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.890337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172522f-85bf-4840-b9f9-fb2dd40a9a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.892169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172522f-85bf-4840-b9f9-fb2dd40a9a71 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.907180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1334/2657] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:01:56.908945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:56.919513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84f09-0fc3-42b7-b2c2-0ebaa8a937ae admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:56.924143 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:56.924795 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:56.925127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:56.925392 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] PATH_INFO: `/v3/projects/ad585f628f104a539e9db1c66115df9d/users/f5aef808e1cb4ee588e96e663a9908d3/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:56.942206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad585f628f104a539e9db1c66115df9d, user_id=f5aef808e1cb4ee588e96e663a9908d3, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:56.944935 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:56.960460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1324/2658] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:56 2022] PUT /identity/v3/projects/ad585f628f104a539e9db1c66115df9d/users/f5aef808e1cb4ee588e96e663a9908d3/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:57.031768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:57.032404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:57.032404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:57.064089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] MFA Rules not processed for user `f5aef808e1cb4ee588e96e663a9908d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:57.065296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:57.140450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1335/2659] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:01:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:57.152313 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:57.154153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:57.213919 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4750-af45-4899-a18f-a6e2e7ca7098 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:57.219390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb98ec-28a5-421d-a844-3f91bfa0dc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:57.220278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb98ec-28a5-421d-a844-3f91bfa0dc7e service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:57.220648 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb98ec-28a5-421d-a844-3f91bfa0dc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:57.221010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb98ec-28a5-421d-a844-3f91bfa0dc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:57.234656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb98ec-28a5-421d-a844-3f91bfa0dc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:57.236095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb98ec-28a5-421d-a844-3f91bfa0dc7e service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:57.245470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1325/2660] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:07.137961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:07.241384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:13.295816 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:13.297438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:13.431931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db0b3-0f7a-4683-ad9d-4109d11f1bca None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:13.437552 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:13.438237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:13.438518 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:13.438793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] PATH_INFO: `/v3/users/9e11ae5ac8f4474a907ef9b70d1204ae` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:13.439987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e11ae5ac8f4474a907ef9b70d1204ae)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:13.442005 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:13.491316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e11ae5ac8f4474a907ef9b70d1204ae'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:13.491972 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e11ae5ac8f4474a907ef9b70d1204ae'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:13.500310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e11ae5ac8f4474a907ef9b70d1204ae'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:13.500933 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e11ae5ac8f4474a907ef9b70d1204ae'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:13.512918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e11ae5ac8f4474a907ef9b70d1204ae'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:13.524918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1336/2661] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:13 2022] DELETE /identity/v3/users/9e11ae5ac8f4474a907ef9b70d1204ae => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:13.531856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:13.532495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:13.532495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:13.563955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:13.565178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:13.631549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1326/2662] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:13.642603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:13.644106 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:13.669236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:13.730927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976edfe-6669-4dda-a302-b5f4d3a80aec admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:13.734656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:13.735275 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:13.735550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:13.735818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:13.745257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:13.746799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:13.758906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1337/2663] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:14.048532 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:14.050222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:14.063379 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3a113-2987-480f-9462-a8fc413c72d8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:14.068656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:14.069430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:14.069787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:14.070242 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] PATH_INFO: `/v3/projects/f241634811ba4e5d927edf9ddb596cc4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:14.071525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f241634811ba4e5d927edf9ddb596cc4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:14.075202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:14.131428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f241634811ba4e5d927edf9ddb596cc4', 'request_id': 'req-67b73e78-3d7e-4933-9cc4-fca6f2625e14'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.139510 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f241634811ba4e5d927edf9ddb596cc4', 'request_id': 'req-67b73e78-3d7e-4933-9cc4-fca6f2625e14'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.147566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f241634811ba4e5d927edf9ddb596cc4', 'request_id': 'req-67b73e78-3d7e-4933-9cc4-fca6f2625e14'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.158771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] The token cache is being invalidate because project f241634811ba4e5d927edf9ddb596cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:14.159053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.159674 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.161333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1327/2664] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:14 2022] DELETE /identity/v3/projects/f241634811ba4e5d927edf9ddb596cc4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:14.165388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:14.175890 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be14a4-2cf3-4d06-b738-9877df52526c service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:14.235857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:14.236502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:14.236777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:14.237053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] PATH_INFO: `/v3/users/f3c0ab09042a472d858bae2772c1bfcd` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:14.238342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c0ab09042a472d858bae2772c1bfcd)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:14.240180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:14.293393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c0ab09042a472d858bae2772c1bfcd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.294076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c0ab09042a472d858bae2772c1bfcd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.304049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c0ab09042a472d858bae2772c1bfcd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.305010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c0ab09042a472d858bae2772c1bfcd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.318104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5aee6fbf-b202-4f7d-b61c-846c9cf22249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c0ab09042a472d858bae2772c1bfcd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.330507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1338/2665] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:14 2022] DELETE /identity/v3/users/f3c0ab09042a472d858bae2772c1bfcd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:14.639108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:14.640604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:14.656107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b73e78-3d7e-4933-9cc4-fca6f2625e14 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:14.715943 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:14.716506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:14.716784 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:14.717051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] PATH_INFO: `/v3/projects/ab4d6e32bffb4f329845db6b7ef309ca` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:14.718332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4d6e32bffb4f329845db6b7ef309ca)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:14.720280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:14.741917 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:14.771419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4d6e32bffb4f329845db6b7ef309ca', 'request_id': 'req-f3a779cd-1249-4bfe-9fd2-beb8253887aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.777527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4d6e32bffb4f329845db6b7ef309ca', 'request_id': 'req-f3a779cd-1249-4bfe-9fd2-beb8253887aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.787214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4d6e32bffb4f329845db6b7ef309ca', 'request_id': 'req-f3a779cd-1249-4bfe-9fd2-beb8253887aa'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.798791 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] The token cache is being invalidate because project ab4d6e32bffb4f329845db6b7ef309ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:14.799087 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.799821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f3a779cd-1249-4bfe-9fd2-beb8253887aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:14.801465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1328/2666] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:14 2022] DELETE /identity/v3/projects/ab4d6e32bffb4f329845db6b7ef309ca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:14.806804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:14.807200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:14.807487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:14.845632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:14.864138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:14.865346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:14.924948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1339/2667] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:14.933156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:14.933441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:14.933724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:14.954192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:14.955419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:14.963787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1329/2668] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:14.968789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:14.983278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb40f42-651d-4e06-8cf2-30ef0c38646f None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:14.991856 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:14.992670 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:14.993050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:14.993445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:14.994393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:14.994701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:14.996371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.008138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1340/2669] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:15.014979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.024400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851403a2-c6b9-4f2f-9cd6-cda59e2a9bdb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.029388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.030014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.030290 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.030554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.031198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.033108 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.063402 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1330/2670] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:15 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:15.067636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.078085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bbe45-59aa-47da-a8dd-64c1d7fc81fb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.134696 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.135307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.135596 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.135867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.136515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.138520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.161664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1341/2671] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:15 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:15.166052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.176818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22507-5bf1-4ae6-bd3d-bfe378fc256c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.181685 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.182307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.182590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.182868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.183547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.185188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.197841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1331/2672] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:15.202724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.213521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611411f-c36f-41f1-b3c8-1b8cc6bd7073 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.219378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112afd88-b794-4577-bb87-e8d67861f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.219943 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112afd88-b794-4577-bb87-e8d67861f7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.220220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112afd88-b794-4577-bb87-e8d67861f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.220490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112afd88-b794-4577-bb87-e8d67861f7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.221144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112afd88-b794-4577-bb87-e8d67861f7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.222914 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112afd88-b794-4577-bb87-e8d67861f7a7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.234460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1342/2673] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:15.240031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.250992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56db0-225f-4037-8555-f21abd9a977e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.256420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.257100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.257373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.257641 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] PATH_INFO: `/v3/projects/490f2e93d7454043ab9db1fb68dd4833/users/b284ab952bab4112af1d71ad64a1307c/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.274824 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490f2e93d7454043ab9db1fb68dd4833, user_id=b284ab952bab4112af1d71ad64a1307c, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.277594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.295211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1332/2674] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:15 2022] PUT /identity/v3/projects/490f2e93d7454043ab9db1fb68dd4833/users/b284ab952bab4112af1d71ad64a1307c/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:15.307231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.307735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.307735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.336864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] MFA Rules not processed for user `b284ab952bab4112af1d71ad64a1307c`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:15.338165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:15.398361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:15.409236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1343/2675] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:15.414367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.484077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461a3cc-4ba9-405d-a0bb-84a27fd3fe91 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.490673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.491851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.492401 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.492915 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.493657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.495631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.525399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1333/2676] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:15 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:15.529866 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.541446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d719-6327-4ae4-a10a-d78b1fad7617 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.586098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.588095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:15.605533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.606199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.606478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.606772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.607494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.609601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.624133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:15.636329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1344/2677] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:15 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:15.640153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.651169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1752a0-93b0-42e6-a775-8d93d0e4ad4d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.656944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.657590 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.657884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.658125 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.658756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.660372 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.673986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1345/2678] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:15.676778 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.689708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c862d13-f163-4db6-9153-e6a2765ae04c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.691298 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9805c-91bd-4377-aec1-50a05d24c7f0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.694566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.695254 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.695556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.695833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] PATH_INFO: `/v3/projects/2947147fc17540efb1162d701231ba4f/users/7583b83502e5434cafd8c377e39c8172/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.697549 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.698215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.698494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.698767 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.700609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:15.711684 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2947147fc17540efb1162d701231ba4f, user_id=7583b83502e5434cafd8c377e39c8172, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.712732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.714352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.714538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.725945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1334/2679] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:02:15.729183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1346/2680] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:15 2022] PUT /identity/v3/projects/2947147fc17540efb1162d701231ba4f/users/7583b83502e5434cafd8c377e39c8172/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:15.733309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.743947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5e94-8636-4ec4-8b49-b3fba89210df service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.802542 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face8b01-3425-497a-af6e-d8b608fc5ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.803244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face8b01-3425-497a-af6e-d8b608fc5ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.803517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face8b01-3425-497a-af6e-d8b608fc5ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.803788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face8b01-3425-497a-af6e-d8b608fc5ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.804463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face8b01-3425-497a-af6e-d8b608fc5ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.806161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face8b01-3425-497a-af6e-d8b608fc5ccd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.817104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1335/2681] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:15.821499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.833478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ff339-e193-41a3-bbeb-454d48432c85 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:15.839748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:15.840445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.840717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.840986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] PATH_INFO: `/v3/projects/2947147fc17540efb1162d701231ba4f/users/7583b83502e5434cafd8c377e39c8172/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.843701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2947147fc17540efb1162d701231ba4f, user_id=7583b83502e5434cafd8c377e39c8172, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:15.846513 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:15.857912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1347/2682] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:15 2022] PUT /identity/v3/projects/2947147fc17540efb1162d701231ba4f/users/7583b83502e5434cafd8c377e39c8172/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:15.868487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:15.868855 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:15.869124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:15.897895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] MFA Rules not processed for user `7583b83502e5434cafd8c377e39c8172`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:15.899147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:15.975800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1336/2683] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:15.991154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:15.994183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:16.055655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93118-c56e-47f6-ba5b-9698277c0744 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:16.059765 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820c5e-b7f8-44b9-9aca-0f100a5d77ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:16.060385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820c5e-b7f8-44b9-9aca-0f100a5d77ab service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:16.060638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820c5e-b7f8-44b9-9aca-0f100a5d77ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:16.060906 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820c5e-b7f8-44b9-9aca-0f100a5d77ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:16.071624 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78820c5e-b7f8-44b9-9aca-0f100a5d77ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:16.073197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78820c5e-b7f8-44b9-9aca-0f100a5d77ab service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:16.083446 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1348/2684] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:16.227733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:16.248720 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:16.294857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63ef83-faca-4e27-80b2-19210438f2e1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:16.299765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:16.300408 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:16.300711 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:16.300961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] PATH_INFO: `/v3/users/b284ab952bab4112af1d71ad64a1307c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:16.302145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b284ab952bab4112af1d71ad64a1307c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:16.304131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:16.353643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b284ab952bab4112af1d71ad64a1307c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.361397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b284ab952bab4112af1d71ad64a1307c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.361997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b284ab952bab4112af1d71ad64a1307c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.374838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b284ab952bab4112af1d71ad64a1307c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.375558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b284ab952bab4112af1d71ad64a1307c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.389378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1337/2685] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:16 2022] DELETE /identity/v3/users/b284ab952bab4112af1d71ad64a1307c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:16.394296 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:16.394833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:16.394833 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:16.418397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:16.419633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:16.457664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:16.485551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1349/2686] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:16.497084 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:16.498785 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:16.569759 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438709e-e976-4cc4-b4bf-9830a45a8222 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:16.573636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:16.574291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:16.574568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:16.574841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:16.584483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:16.585982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:16.596231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1338/2687] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:16.876534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:16.878290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:16.891742 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005bc1-a350-4055-8015-d01de4e0a4a6 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:16.896852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:16.897815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:16.898052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:16.898327 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] PATH_INFO: `/v3/projects/490f2e93d7454043ab9db1fb68dd4833` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:16.899579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] RBAC: Authorizing `identity:delete_project(project_id=490f2e93d7454043ab9db1fb68dd4833)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:16.901702 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:16.954652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490f2e93d7454043ab9db1fb68dd4833', 'request_id': 'req-7e5b81f7-834d-42db-ba49-a9cf75a4443f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.960945 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490f2e93d7454043ab9db1fb68dd4833', 'request_id': 'req-7e5b81f7-834d-42db-ba49-a9cf75a4443f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.969174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490f2e93d7454043ab9db1fb68dd4833', 'request_id': 'req-7e5b81f7-834d-42db-ba49-a9cf75a4443f'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.981141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] The token cache is being invalidate because project 490f2e93d7454043ab9db1fb68dd4833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:16.981411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.982237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:16.983852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1350/2688] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:16 2022] DELETE /identity/v3/projects/490f2e93d7454043ab9db1fb68dd4833 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:16.988142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:16.998299 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7565e-a9d0-41d4-a2e4-5dfd6d974f79 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:17.041268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:17.060333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:17.060986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.061233 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.061499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] PATH_INFO: `/v3/users/7583b83502e5434cafd8c377e39c8172` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.063086 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7583b83502e5434cafd8c377e39c8172)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:17.065035 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:17.116406 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7583b83502e5434cafd8c377e39c8172'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.125017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7583b83502e5434cafd8c377e39c8172'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.125741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7583b83502e5434cafd8c377e39c8172'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.137756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7583b83502e5434cafd8c377e39c8172'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.138447 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-412eb793-6e87-4b76-a6a4-4a9ea5e1aa58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7583b83502e5434cafd8c377e39c8172'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.151374 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1339/2689] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:16 2022] DELETE /identity/v3/users/7583b83502e5434cafd8c377e39c8172 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:17.445534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:17.447257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:17.464280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b81f7-834d-42db-ba49-a9cf75a4443f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:17.524693 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:17.525291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.525589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.525923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] PATH_INFO: `/v3/projects/2947147fc17540efb1162d701231ba4f` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.527101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2947147fc17540efb1162d701231ba4f)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:17.529109 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:17.578648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2947147fc17540efb1162d701231ba4f', 'request_id': 'req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.588052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2947147fc17540efb1162d701231ba4f', 'request_id': 'req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.598549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2947147fc17540efb1162d701231ba4f', 'request_id': 'req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.602981 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:17.612500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] The token cache is being invalidate because project 2947147fc17540efb1162d701231ba4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:17.612811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.613744 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1f6f08b3-1ac6-42ec-a51d-f665b34e05b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:17.615638 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1351/2690] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:17 2022] DELETE /identity/v3/projects/2947147fc17540efb1162d701231ba4f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:17.622114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.622397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.622657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.644992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:17.646270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:17.714886 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1340/2691] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:17.723758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.724036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.724346 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.745034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:17.746332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:17.754630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1352/2692] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:17.760877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:17.770965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87185a-cb85-48f8-907c-2a86838c3916 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:17.776140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:17.776752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.777060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.777339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.778017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:17.778320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:17.779925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:17.791882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1341/2693] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:17.798433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:17.815266 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b19cf-00fd-4296-ad14-c6a62b6ab18d None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:17.824105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:17.824735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.824994 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.825260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.825964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:17.827942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:17.859768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1353/2694] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:17.864689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:17.876279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae0b5a-d1d1-4cfb-9c96-c28e406fb79a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:17.927596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:17.941959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:17.942665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.942951 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.943241 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.943882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:17.945979 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:17.968573 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1342/2695] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:17 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:17.973355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:17.984631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e9513-e8a5-4065-ac51-53709436437e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:17.992299 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:17.993192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:17.993566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:17.993930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:17.994766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:17.996474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.007491 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1354/2696] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:18.011842 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.022357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e69db-99b2-4f20-9e8d-46eb5af573fc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:18.027486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665279ff-484c-4fae-a1d1-46e5f70fd238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:18.028092 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665279ff-484c-4fae-a1d1-46e5f70fd238 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.028366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665279ff-484c-4fae-a1d1-46e5f70fd238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.028644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665279ff-484c-4fae-a1d1-46e5f70fd238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.029309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665279ff-484c-4fae-a1d1-46e5f70fd238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:18.030955 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665279ff-484c-4fae-a1d1-46e5f70fd238 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.041868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1343/2697] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:18.047011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.060931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7becd5-c627-459f-8c0d-26fc52195983 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:18.066195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:18.066844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.067159 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.067426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] PATH_INFO: `/v3/projects/5fc4ee4326814867aa45694addedcd69/users/4fd13d1b85e14ce7ba57f4401bb0827f/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.082336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc4ee4326814867aa45694addedcd69, user_id=4fd13d1b85e14ce7ba57f4401bb0827f, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:18.085158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.102436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1355/2698] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:18 2022] PUT /identity/v3/projects/5fc4ee4326814867aa45694addedcd69/users/4fd13d1b85e14ce7ba57f4401bb0827f/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:18.115640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.115899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.116289 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.148462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] MFA Rules not processed for user `4fd13d1b85e14ce7ba57f4401bb0827f`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:18.149686 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.214962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1344/2699] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:18.226276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.228138 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.285401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621e7f9-b4f1-498a-9997-792632d3d187 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:18.289469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9bf2-7f04-4e33-97e3-00d10cbe5321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:18.290151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9bf2-7f04-4e33-97e3-00d10cbe5321 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.290432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9bf2-7f04-4e33-97e3-00d10cbe5321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.290704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9bf2-7f04-4e33-97e3-00d10cbe5321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.299306 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9bf2-7f04-4e33-97e3-00d10cbe5321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:18.300751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9bf2-7f04-4e33-97e3-00d10cbe5321 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.309612 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1356/2700] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:18.330165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.394414 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61d68-fc72-4cd1-8d29-bf655cac39d8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:18.399952 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:18.400585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.400880 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.401152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] PATH_INFO: `/v3/users/4fd13d1b85e14ce7ba57f4401bb0827f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.402354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd13d1b85e14ce7ba57f4401bb0827f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:18.404295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.461471 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd13d1b85e14ce7ba57f4401bb0827f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.471345 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd13d1b85e14ce7ba57f4401bb0827f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.472079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd13d1b85e14ce7ba57f4401bb0827f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.479431 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:18.489135 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd13d1b85e14ce7ba57f4401bb0827f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.490100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd13d1b85e14ce7ba57f4401bb0827f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.502745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1345/2701] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:18 2022] DELETE /identity/v3/users/4fd13d1b85e14ce7ba57f4401bb0827f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:18.507406 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.507874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.507969 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.527801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:18.529034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.598189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1357/2702] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:18.609794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.611390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.671124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8b603-4a94-46de-a425-726760cf9611 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:18.675488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c613b7b-9ff0-43df-a538-d2d7642f608b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:18.676107 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c613b7b-9ff0-43df-a538-d2d7642f608b service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.676378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c613b7b-9ff0-43df-a538-d2d7642f608b service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.676642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c613b7b-9ff0-43df-a538-d2d7642f608b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.686809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c613b7b-9ff0-43df-a538-d2d7642f608b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:18.688778 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c613b7b-9ff0-43df-a538-d2d7642f608b service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.699198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1346/2703] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:18.768194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.770335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.782947 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcb3a5-d5e6-4db7-90a2-5c9ae149e3f9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:18.789049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:18.789677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.790009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.790282 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] PATH_INFO: `/v3/users/f5aef808e1cb4ee588e96e663a9908d3` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.791538 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aef808e1cb4ee588e96e663a9908d3)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:18.793553 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:18.833640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:18.853525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aef808e1cb4ee588e96e663a9908d3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.854196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aef808e1cb4ee588e96e663a9908d3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.864349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aef808e1cb4ee588e96e663a9908d3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.864998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aef808e1cb4ee588e96e663a9908d3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.877468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aef808e1cb4ee588e96e663a9908d3'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:18.891013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1358/2704] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:18 2022] DELETE /identity/v3/users/f5aef808e1cb4ee588e96e663a9908d3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:18.895580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:18.895925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:18.896263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:18.915736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:18.916986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.979195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1347/2705] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:18.982835 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.984333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.988882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:18.990629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:18.999773 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9e1f-3f22-4e96-8b44-125b1e9cd426 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.005012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.005826 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.006156 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.006962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] PATH_INFO: `/v3/projects/5fc4ee4326814867aa45694addedcd69` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.008043 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc4ee4326814867aa45694addedcd69)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.010427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.054264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5320b-14d3-48b3-895f-a5fc35e54161 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.063597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc4ee4326814867aa45694addedcd69', 'request_id': 'req-01a7d329-e8dc-4774-9df0-d49c735532cd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.070004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc4ee4326814867aa45694addedcd69', 'request_id': 'req-01a7d329-e8dc-4774-9df0-d49c735532cd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.080002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc4ee4326814867aa45694addedcd69', 'request_id': 'req-01a7d329-e8dc-4774-9df0-d49c735532cd'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.091140 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] The token cache is being invalidate because project 5fc4ee4326814867aa45694addedcd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:19.091429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.091900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:19.092131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-01a7d329-e8dc-4774-9df0-d49c735532cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.093884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1359/2706] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:18 2022] DELETE /identity/v3/projects/5fc4ee4326814867aa45694addedcd69 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:19.098647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6d8a-5f31-4f3c-91e5-b0265548afd6 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.098932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6d8a-5f31-4f3c-91e5-b0265548afd6 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.099214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6d8a-5f31-4f3c-91e5-b0265548afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.112209 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.112823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.113095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.113365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.115467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.119451 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b13b6d8a-5f31-4f3c-91e5-b0265548afd6 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:19.120636 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b13b6d8a-5f31-4f3c-91e5-b0265548afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.180136 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.181489 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.181606 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1360/2707] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:19.189725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.190049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.190326 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.199139 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1348/2708] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:02:19.211206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:19.212452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.221390 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1361/2709] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:19.225910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.236119 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a945-1acc-47fc-bfdf-475fa606aab4 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.241750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.242518 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.242870 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.243302 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.244071 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:19.244451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.246544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.259673 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1349/2710] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:02:19.264439 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.274680 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023741a-7b6d-4f41-ae96-2ba2592183b7 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.279103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.280081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.280213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.280421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.281065 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.283059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.305661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:19.314764 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1362/2711] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:19.318976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.330147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd0e4a-60b4-4af1-b8d7-2c5fb6a7f134 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.395596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.396612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.397003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.397294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.397976 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.399934 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.421998 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1350/2712] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:19.426393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.437867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2a5eb-b9ce-4704-b5db-fa2182343b27 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.442823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.443528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.443841 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.444114 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.444748 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.446398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.456913 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1363/2713] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:19.461178 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.472168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515511-2241-4338-9c33-b7318c54347a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.476835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.477442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.477737 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.478051 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.478718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.480484 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.490173 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.492232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.494551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1351/2714] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:19.498836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.507749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e127bc-9d96-4027-9261-d6d32a6f2a5b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.510234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1c74a-2f24-4786-bccd-b413b3405b83 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.512805 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.513450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.513731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.514057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] PATH_INFO: `/v3/projects/ad585f628f104a539e9db1c66115df9d` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.515183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad585f628f104a539e9db1c66115df9d)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.515843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd09c-a306-4016-a228-2693a0979383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.517188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd09c-a306-4016-a228-2693a0979383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.517399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.517950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd09c-a306-4016-a228-2693a0979383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.518228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd09c-a306-4016-a228-2693a0979383 admin admin] PATH_INFO: `/v3/projects/4375ea9080d245619ef56d262a50eaed/users/469a5fd9315c4f308930b5fb9d3a3c6e/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.533687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd09c-a306-4016-a228-2693a0979383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4375ea9080d245619ef56d262a50eaed, user_id=469a5fd9315c4f308930b5fb9d3a3c6e, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.536344 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd09c-a306-4016-a228-2693a0979383 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.552365 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1352/2715] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:19 2022] PUT /identity/v3/projects/4375ea9080d245619ef56d262a50eaed/users/469a5fd9315c4f308930b5fb9d3a3c6e/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:19.563469 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.563745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.564013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.567145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad585f628f104a539e9db1c66115df9d', 'request_id': 'req-b8e434dd-4bd7-4e56-b410-f8e70377e723'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.574014 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad585f628f104a539e9db1c66115df9d', 'request_id': 'req-b8e434dd-4bd7-4e56-b410-f8e70377e723'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.583775 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad585f628f104a539e9db1c66115df9d', 'request_id': 'req-b8e434dd-4bd7-4e56-b410-f8e70377e723'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.592545 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] MFA Rules not processed for user `469a5fd9315c4f308930b5fb9d3a3c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:19.593807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.594774 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] The token cache is being invalidate because project ad585f628f104a539e9db1c66115df9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:19.595080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.595747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b8e434dd-4bd7-4e56-b410-f8e70377e723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:19.597310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1364/2716] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:19 2022] DELETE /identity/v3/projects/ad585f628f104a539e9db1c66115df9d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:19.602311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a203-acda-41eb-9391-390b6beda43c None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.602592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a203-acda-41eb-9391-390b6beda43c None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.602868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a203-acda-41eb-9391-390b6beda43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.606626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:19.622632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6725a203-acda-41eb-9391-390b6beda43c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:19.623851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6725a203-acda-41eb-9391-390b6beda43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.658921 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1353/2717] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:19.664106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.665525 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.684716 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1365/2718] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:19.692818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.693074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.693411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.712753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:19.714144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:19.723414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1366/2719] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:19.727657 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.730236 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bedeaf-5a68-4e24-9438-1a200fa439ef None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.734918 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.735562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.735836 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.736101 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.736739 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60eded-0450-489f-800f-655eb7f68eec None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.736845 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.738690 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.742261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.742869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.743141 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.743411 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.744052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:19.744358 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.746053 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.757749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1367/2720] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:19.762349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.768552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1354/2721] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:19.772584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938d28-ae20-4edf-a492-b2368341c66f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.773338 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.822318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:19.831709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.832338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.832621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.832951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.833524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.835527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.838604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3527d7-48b0-4037-b788-447ecb2647a5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.848386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.849497 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.850319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.850319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.850684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.852620 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.865698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1368/2722] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:19.869848 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.874818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1355/2723] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:19.878761 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.889982 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4950c-37ad-41a9-96fe-e42c25d39540 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.920418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:19.930738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16110e3-e735-4f73-a126-a58d9aef8de9 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.936042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.936655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.936929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.937195 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.938205 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.940170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.948671 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.949258 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.949537 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.949831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.950481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.952129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.962505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1356/2724] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:19.962673 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1369/2725] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:19 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:19.966638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.969499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:19.976581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5fa4e-13bc-498c-aa22-d7c3c707d179 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.979303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2ad6-0686-4ce2-8ab0-7948949c6878 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:19.981202 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.981827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.982106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.982376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.983021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.984011 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:19.984609 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.984789 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:19.985083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:19.985355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:19.986026 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:19.987601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:19.995264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1357/2726] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:19.998545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1370/2727] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:19.999339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.001377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.008971 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fccc7-5743-48fd-be7b-fe3fee1ec6ce admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.010934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140b1a-b345-4186-9bfe-44cafbed1770 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.013755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40960deb-8629-4a64-841e-ef1c4516b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.014427 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40960deb-8629-4a64-841e-ef1c4516b59d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.014700 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40960deb-8629-4a64-841e-ef1c4516b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.014968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40960deb-8629-4a64-841e-ef1c4516b59d admin admin] PATH_INFO: `/v3/projects/dccf7229cc1544c99e76284bd5fb7abe/users/1b93b01d06284bed88bee360fb79a466/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.015809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.016398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.016671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.016941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.017567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.019193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.030063 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40960deb-8629-4a64-841e-ef1c4516b59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccf7229cc1544c99e76284bd5fb7abe, user_id=1b93b01d06284bed88bee360fb79a466, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.030661 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1371/2728] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:20.032812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40960deb-8629-4a64-841e-ef1c4516b59d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.034963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.045189 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc923935-f394-407b-9c48-b4e607c07639 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.047805 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1358/2729] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:19 2022] PUT /identity/v3/projects/dccf7229cc1544c99e76284bd5fb7abe/users/1b93b01d06284bed88bee360fb79a466/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:20.060357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.061016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.061016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.090438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] MFA Rules not processed for user `1b93b01d06284bed88bee360fb79a466`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:20.091866 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:20.106421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24be1a8-0cc7-435c-9c2e-2323142eb664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.107090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be1a8-0cc7-435c-9c2e-2323142eb664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.107363 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be1a8-0cc7-435c-9c2e-2323142eb664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.107808 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be1a8-0cc7-435c-9c2e-2323142eb664 admin admin] PATH_INFO: `/v3/projects/fdd5d77d519c46689286cec82a24d9b7/users/951b4d24f5c4460db22218f94ded0c57/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.122565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be1a8-0cc7-435c-9c2e-2323142eb664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd5d77d519c46689286cec82a24d9b7, user_id=951b4d24f5c4460db22218f94ded0c57, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.125253 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be1a8-0cc7-435c-9c2e-2323142eb664 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.143031 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1372/2730] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:20 2022] PUT /identity/v3/projects/fdd5d77d519c46689286cec82a24d9b7/users/951b4d24f5c4460db22218f94ded0c57/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:20.149028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.149311 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.149574 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.170733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:20.171975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:20.200796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:20.242549 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1373/2731] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:20.253307 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.254883 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:20.288908 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1359/2732] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:20.293551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.303830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a5e1-7fa8-4d5b-a91f-47626fd2c292 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.308436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.309109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.309386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.309804 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.310473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.312867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.313169 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b616b-5106-4760-b973-ea2ccb1d131b None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.316919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.317560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.317877 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.318153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.327708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.329221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.339417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1374/2733] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:02:20.341424 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1360/2734] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:20.345448 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.355431 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43567f05-7ea8-45a5-b3d9-a2adedaa68b7 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.414143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.414948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.415316 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.415695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.416586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.418706 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.441023 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1375/2735] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:20 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:20.445342 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.456499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b77adc-0648-41e5-87d9-f9272efa72b3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.465206 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.466603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.467141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.467745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.468535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.471032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.484193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1361/2736] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:20.488632 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.500042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a7757-419f-4495-a9c7-50573ce261fd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.505391 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.506336 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.506763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.507148 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] PATH_INFO: `/v3/projects/8f027d785b7f46aa9346e404136703ea/users/c44aa9b70b344930902ed4dc3f6fa177/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.524231 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f027d785b7f46aa9346e404136703ea, user_id=c44aa9b70b344930902ed4dc3f6fa177, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.527139 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.540937 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1376/2737] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:20 2022] PUT /identity/v3/projects/8f027d785b7f46aa9346e404136703ea/users/c44aa9b70b344930902ed4dc3f6fa177/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:20.545295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.555873 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977a03-4607-4e19-95b9-3d06ba7cdce6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.606169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:20.620555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5f2f3-86ea-4faa-8edf-340d9debe3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.621186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f2f3-86ea-4faa-8edf-340d9debe3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.621456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f2f3-86ea-4faa-8edf-340d9debe3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.621722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f2f3-86ea-4faa-8edf-340d9debe3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.622412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5f2f3-86ea-4faa-8edf-340d9debe3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.624033 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5f2f3-86ea-4faa-8edf-340d9debe3c7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.634874 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1362/2738] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:20.639512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.650851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0e27f-d1a8-4879-b175-487f9b2e210d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.657635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.664181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.664509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.664840 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] PATH_INFO: `/v3/projects/8f027d785b7f46aa9346e404136703ea/users/c44aa9b70b344930902ed4dc3f6fa177/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.667626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f027d785b7f46aa9346e404136703ea, user_id=c44aa9b70b344930902ed4dc3f6fa177, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.670388 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.683557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1377/2739] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:20 2022] PUT /identity/v3/projects/8f027d785b7f46aa9346e404136703ea/users/c44aa9b70b344930902ed4dc3f6fa177/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:20.695291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.695980 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.696391 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.726634 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] MFA Rules not processed for user `c44aa9b70b344930902ed4dc3f6fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:20.728259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:20.805282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1363/2740] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:20.824534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:20.826458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:20.868308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:20.901614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e8eba-3f08-4201-9e3a-002577636859 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:20.905526 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:20.906397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:20.906737 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:20.907076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:20.973963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:20.975490 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:20.990565 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1378/2741] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:02:22.705013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:22.706739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:22.720865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1807c54-f8bb-43c2-9a52-9f9180d2c109 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:22.725207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e51da6-84c7-4339-9c12-48e703a3faa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:22.725889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51da6-84c7-4339-9c12-48e703a3faa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:22.726168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51da6-84c7-4339-9c12-48e703a3faa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:22.726436 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51da6-84c7-4339-9c12-48e703a3faa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:22.799514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e51da6-84c7-4339-9c12-48e703a3faa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:22.800992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e51da6-84c7-4339-9c12-48e703a3faa3 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:22.812183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1364/2742] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:23.436384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:23.446432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d14c4-a477-4263-b6a6-e8fb3ac24e22 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:23.451056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:23.451712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:23.452001 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:23.452289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:23.462304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:23.464012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:23.475037 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1379/2743] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:25.158223 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.159060 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.159347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.190765 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] MFA Rules not processed for user `951b4d24f5c4460db22218f94ded0c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:25.192013 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:25.270231 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:25.277928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1365/2744] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:25.281920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:25.359873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c9302-804f-48e6-bb09-0f67a101e317 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:25.365178 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:25.365870 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.366158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.366436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.367086 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:25.369012 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:25.403524 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1380/2745] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:25 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:25.407958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:25.419731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d38250-7ef2-4d3f-aa85-d7695875cc53 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:25.480186 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:25.480819 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.481083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.481522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.482269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:25.484214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:25.506688 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1366/2746] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:25 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:25.510687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:25.521888 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85039f2b-337d-431e-941a-f673c2ea11bb admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:25.527032 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:25.527678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.527942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.528213 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.529020 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:25.530705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:25.542464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1381/2747] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:25.546733 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:25.557904 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25472c17-6edb-4814-9661-b8bee27f65e3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:25.563764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:25.564459 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.564728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.564994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] PATH_INFO: `/v3/projects/fe1ba97c0a4f4b44bfce1b5b50aa5c74/users/9e6381a9d4ca42b8931ae6e2e5e4b21e/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.583234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1ba97c0a4f4b44bfce1b5b50aa5c74, user_id=9e6381a9d4ca42b8931ae6e2e5e4b21e, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:25.585900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:25.603996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1367/2748] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:25 2022] PUT /identity/v3/projects/fe1ba97c0a4f4b44bfce1b5b50aa5c74/users/9e6381a9d4ca42b8931ae6e2e5e4b21e/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:25.605279 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:25.615880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb877e9-7afc-461f-90e5-24b052a9069b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:25.681276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:25.705511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:25.706186 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.706463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.706728 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.707365 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:25.709269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:25.720724 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1382/2749] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:25.724947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:25.736185 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af329a6-3512-48a3-84e8-5f6ec5d1dee2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:25.742198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032adaca-04cd-4263-b4e1-b5950f42a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:25.742897 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032adaca-04cd-4263-b4e1-b5950f42a889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:25.743166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032adaca-04cd-4263-b4e1-b5950f42a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:25.744362 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032adaca-04cd-4263-b4e1-b5950f42a889 admin admin] PATH_INFO: `/v3/projects/fe1ba97c0a4f4b44bfce1b5b50aa5c74/users/9e6381a9d4ca42b8931ae6e2e5e4b21e/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:25.746603 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032adaca-04cd-4263-b4e1-b5950f42a889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1ba97c0a4f4b44bfce1b5b50aa5c74, user_id=9e6381a9d4ca42b8931ae6e2e5e4b21e, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:25.749296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032adaca-04cd-4263-b4e1-b5950f42a889 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:25.760665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1368/2750] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:25 2022] PUT /identity/v3/projects/fe1ba97c0a4f4b44bfce1b5b50aa5c74/users/9e6381a9d4ca42b8931ae6e2e5e4b21e/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:27.805364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:27.825865 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0341c6d-7c01-4f38-8ddb-942fed27112c admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:27.959338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:27.959338 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:27.959853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:27.960227 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] PATH_INFO: `/v3/users/469a5fd9315c4f308930b5fb9d3a3c6e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:27.961982 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=469a5fd9315c4f308930b5fb9d3a3c6e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:27.964314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:28.059874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469a5fd9315c4f308930b5fb9d3a3c6e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:28.060733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469a5fd9315c4f308930b5fb9d3a3c6e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:28.075509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469a5fd9315c4f308930b5fb9d3a3c6e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:28.076304 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469a5fd9315c4f308930b5fb9d3a3c6e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:28.106335 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469a5fd9315c4f308930b5fb9d3a3c6e'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:28.123456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1383/2751] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:27 2022] DELETE /identity/v3/users/469a5fd9315c4f308930b5fb9d3a3c6e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:28.128266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:28.128764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:28.129116 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:28.169622 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:28.171145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:28.282894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1369/2752] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:28.309902 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:28.311408 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:28.445083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:28.503373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541133-7f94-4226-9645-ed44b0edc36a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:28.508152 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:28.508812 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:28.509097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:28.509374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:28.542958 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:28.544494 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:28.567979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1384/2753] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:29.225161 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:29.227316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:29.239931 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2dbd2-cf45-4b79-842a-e8f07b548a08 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:29.245857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:29.246527 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:29.246788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:29.247387 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] PATH_INFO: `/v3/projects/4375ea9080d245619ef56d262a50eaed` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:29.248568 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4375ea9080d245619ef56d262a50eaed)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:29.251584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:29.315698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:29.320925 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4375ea9080d245619ef56d262a50eaed', 'request_id': 'req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.331638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4375ea9080d245619ef56d262a50eaed', 'request_id': 'req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.343916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4375ea9080d245619ef56d262a50eaed', 'request_id': 'req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.361428 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] The token cache is being invalidate because project 4375ea9080d245619ef56d262a50eaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:29.361930 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.362956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.365061 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1370/2754] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:29 2022] DELETE /identity/v3/projects/4375ea9080d245619ef56d262a50eaed => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:29.369166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:29.379595 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a99592-9a9c-4cb4-b795-1a1f8af8ee87 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:29.450235 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:29.451124 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:29.451420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:29.451677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] PATH_INFO: `/v3/users/1b93b01d06284bed88bee360fb79a466` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:29.452847 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b93b01d06284bed88bee360fb79a466)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:29.454995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:29.526795 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b93b01d06284bed88bee360fb79a466'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.527641 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b93b01d06284bed88bee360fb79a466'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.544076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b93b01d06284bed88bee360fb79a466'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.544919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b93b01d06284bed88bee360fb79a466'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.562867 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b93b01d06284bed88bee360fb79a466'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:29.580919 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1385/2755] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:29 2022] DELETE /identity/v3/users/1b93b01d06284bed88bee360fb79a466 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:30.438576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:30.441335 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:30.465439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9806e6-e248-4fd0-ba3d-abc31c9d5064 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:30.552807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:30.553468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:30.553740 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:30.554058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] PATH_INFO: `/v3/projects/dccf7229cc1544c99e76284bd5fb7abe` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:30.555625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccf7229cc1544c99e76284bd5fb7abe)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:30.557960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:30.624754 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccf7229cc1544c99e76284bd5fb7abe', 'request_id': 'req-492d55c4-7219-490c-91fa-bbe3de5eaafd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.634638 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccf7229cc1544c99e76284bd5fb7abe', 'request_id': 'req-492d55c4-7219-490c-91fa-bbe3de5eaafd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.655719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccf7229cc1544c99e76284bd5fb7abe', 'request_id': 'req-492d55c4-7219-490c-91fa-bbe3de5eaafd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.669074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] The token cache is being invalidate because project dccf7229cc1544c99e76284bd5fb7abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:30.669375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.670317 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.672234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1371/2756] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:30 2022] DELETE /identity/v3/projects/dccf7229cc1544c99e76284bd5fb7abe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:30.676498 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:30.678110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:30.694429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2f8d-6a45-4ea6-b17d-bd7087bee656 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:30.757256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:30.765496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:30.766295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:30.766614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:30.766907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] PATH_INFO: `/v3/users/c44aa9b70b344930902ed4dc3f6fa177` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:30.770061 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44aa9b70b344930902ed4dc3f6fa177)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:30.771931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:30.846089 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44aa9b70b344930902ed4dc3f6fa177'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.847608 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44aa9b70b344930902ed4dc3f6fa177'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.858749 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44aa9b70b344930902ed4dc3f6fa177'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.859414 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44aa9b70b344930902ed4dc3f6fa177'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.886955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44aa9b70b344930902ed4dc3f6fa177'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:30.916380 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1386/2757] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:30 2022] DELETE /identity/v3/users/c44aa9b70b344930902ed4dc3f6fa177 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:31.589900 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:31.591430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:31.592405 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:31.593057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:31.703859 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d55c4-7219-490c-91fa-bbe3de5eaafd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:31.712534 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cdf99-6244-4dba-b453-d384fd491fbd admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:31.719244 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:31.719941 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:31.720687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:31.720979 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] PATH_INFO: `/v3/projects/8f027d785b7f46aa9346e404136703ea` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:31.722845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f027d785b7f46aa9346e404136703ea)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:31.726027 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:31.740366 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:31.799479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f027d785b7f46aa9346e404136703ea', 'request_id': 'req-157791d6-7b6e-4704-8eed-1a372f27263c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:31.809830 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f027d785b7f46aa9346e404136703ea', 'request_id': 'req-157791d6-7b6e-4704-8eed-1a372f27263c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:31.821881 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:31.822554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:31.822945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:31.823222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:31.825145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:31.836964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f027d785b7f46aa9346e404136703ea', 'request_id': 'req-157791d6-7b6e-4704-8eed-1a372f27263c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:31.849132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:31.850969 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473a6a4-6664-4d3e-b4e7-dbfeb278f58e service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:31.864888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1372/2758] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:31.866265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] The token cache is being invalidate because project 8f027d785b7f46aa9346e404136703ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:31.866609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:31.872452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-157791d6-7b6e-4704-8eed-1a372f27263c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:31.876964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1387/2759] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:31 2022] DELETE /identity/v3/projects/8f027d785b7f46aa9346e404136703ea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:31.881625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:31.882008 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:31.883604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:31.939259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:31.940751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:32.079541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1373/2760] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:32.082239 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ec5b5-ebf1-4265-9d0b-c3ec6f2d5622 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.082605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ec5b5-ebf1-4265-9d0b-c3ec6f2d5622 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.082952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ec5b5-ebf1-4265-9d0b-c3ec6f2d5622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.108207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.127207 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-214ec5b5-ebf1-4265-9d0b-c3ec6f2d5622 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:32.128923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-214ec5b5-ebf1-4265-9d0b-c3ec6f2d5622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:32.137903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1388/2761] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:32.142367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.153005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c33b7-fe3a-411c-8913-b25b0e1a858a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.158860 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.159922 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.160031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.160351 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.161075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:32.161446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.163151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.168093 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.168580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.168930 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.182985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1374/2762] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:02:32.188452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.200114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e896-fa24-4363-a1c6-e24cb5ea5e56 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.205294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.205959 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.206291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.206576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.207276 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.209480 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.212034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] MFA Rules not processed for user `9e6381a9d4ca42b8931ae6e2e5e4b21e`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:32.213796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:32.254400 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1375/2763] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:32 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:32.269635 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.413896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1389/2764] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:32.428645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d57eb-acb0-43fb-a287-81adcf7bf98d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.429677 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.431134 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:32.445334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.447203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.447582 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.448696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.449462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.451707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.491816 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1376/2765] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:32 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:32.496371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.519286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3b2c-ea37-46c9-a06a-35d809bc3692 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.530877 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.531687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.532666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.533047 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.534689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.537171 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.567888 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1377/2766] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:32.571604 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.601381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909d0d-72ad-4b19-ba1c-d4c77cb101f5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.617463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.618442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.618884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.619310 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.622159 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.624658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.627169 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.627797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1a344-d495-440d-ab23-dec20f80c5af None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.651787 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1378/2767] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:32.657301 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.677535 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553266e-6194-4d15-a3b4-66b9b3a6f88b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.695994 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062065c-5700-4b03-bd36-9d630508b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.697070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062065c-5700-4b03-bd36-9d630508b896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.697070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062065c-5700-4b03-bd36-9d630508b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.697382 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062065c-5700-4b03-bd36-9d630508b896 admin admin] PATH_INFO: `/v3/projects/4bb82227ea844514adac6edb21fbac3c/users/b41f66a765384250a123e56e002e95aa/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.731660 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062065c-5700-4b03-bd36-9d630508b896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb82227ea844514adac6edb21fbac3c, user_id=b41f66a765384250a123e56e002e95aa, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.734841 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062065c-5700-4b03-bd36-9d630508b896 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.743362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.769388 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1379/2768] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:32 2022] PUT /identity/v3/projects/4bb82227ea844514adac6edb21fbac3c/users/b41f66a765384250a123e56e002e95aa/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:32.773523 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.774466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.774852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.775204 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.783609 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:32.834618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.834905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.835173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.876381 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] MFA Rules not processed for user `b41f66a765384250a123e56e002e95aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:32.877665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:32.913656 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.915480 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.926717 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1390/2769] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:32.974652 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1380/2770] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:32.988419 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.989942 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:33.140543 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee198-a833-4ae5-b0c3-b762c0cc3dbe service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:33.217243 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:33.217527 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:33.218461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:33.218600 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:33.230566 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:33.232119 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.246869 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1391/2771] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:02:36.318167 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:36.319725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:36.393187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161b91-15cd-426f-8e99-e95debb56758 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:36.398343 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:36.399052 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.399329 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.399619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] PATH_INFO: `/v3/users/324325d907f244beb6862df4116f2c78` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:36.400757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=324325d907f244beb6862df4116f2c78)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:36.408834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:36.460153 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324325d907f244beb6862df4116f2c78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.470731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324325d907f244beb6862df4116f2c78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.471544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324325d907f244beb6862df4116f2c78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.492024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:36.508507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324325d907f244beb6862df4116f2c78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.508997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-38559baa-9ee7-4000-b49f-61db6503b80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324325d907f244beb6862df4116f2c78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.526111 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1381/2772] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:36 2022] DELETE /identity/v3/users/324325d907f244beb6862df4116f2c78 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:36.747781 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:36.767384 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96307ad6-2cc6-47e8-9dbd-2e88b38a5eed service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:36.807095 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:36.852843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:36.854171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.854171 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.854499 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] PATH_INFO: `/v3/projects/81fc613102504ca1a7f12a1fceb2ed51` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:36.855811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fc613102504ca1a7f12a1fceb2ed51)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:36.858087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:36.944797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fc613102504ca1a7f12a1fceb2ed51', 'request_id': 'req-5b2f9871-cad3-48f6-b6c9-16de95ae411c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.951953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fc613102504ca1a7f12a1fceb2ed51', 'request_id': 'req-5b2f9871-cad3-48f6-b6c9-16de95ae411c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.961589 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fc613102504ca1a7f12a1fceb2ed51', 'request_id': 'req-5b2f9871-cad3-48f6-b6c9-16de95ae411c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.973621 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] The token cache is being invalidate because project 81fc613102504ca1a7f12a1fceb2ed51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:36.973993 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.974824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-5b2f9871-cad3-48f6-b6c9-16de95ae411c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:36.976718 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1392/2773] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:36 2022] DELETE /identity/v3/projects/81fc613102504ca1a7f12a1fceb2ed51 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:36.981695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.982204 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.982539 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.005132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:37.006396 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:37.066082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1382/2774] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:37.074313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.074601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.074880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.095329 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:37.096521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:37.105649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1393/2775] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:37.110353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.120594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d80d55-56ab-4614-b4a0-8e04f84efc6c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.126715 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.127619 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.127895 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.128166 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.128856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:37.129151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.130830 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.143746 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1383/2776] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:37.148228 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.157824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892476-80ad-41c1-ad16-62f3040cdcb3 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.163418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.164100 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.164497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.164837 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.165544 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.167668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.203777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1394/2777] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:37 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:37.208032 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.218771 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7708f-a046-46f4-8030-7506e95f1488 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.295012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.295633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.295905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.296168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.296809 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.298766 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.322493 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1384/2778] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:37 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:37.326992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.341920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141c4e-5c9b-4d71-a9c8-ea633c9dc488 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.346790 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.347427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.347727 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.347978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.348659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.350377 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.361533 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1395/2779] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:37.365827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.376341 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec1cbb-4fe7-42e1-b815-94ec373977a0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.381012 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822af66-9e56-418b-8ac5-3fc53751da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.381649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822af66-9e56-418b-8ac5-3fc53751da0d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.381958 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822af66-9e56-418b-8ac5-3fc53751da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.382229 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822af66-9e56-418b-8ac5-3fc53751da0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.382868 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822af66-9e56-418b-8ac5-3fc53751da0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.384474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822af66-9e56-418b-8ac5-3fc53751da0d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.395838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1385/2780] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:37.400516 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.411184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb707-311b-44ac-b2b7-d81b3a279f03 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.416356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.417143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.417428 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.417703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] PATH_INFO: `/v3/projects/3fdf48ab6b994c72994b861fba4887fd/users/96c26d26a0af480ca9cbbd06502de729/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.434184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdf48ab6b994c72994b861fba4887fd, user_id=96c26d26a0af480ca9cbbd06502de729, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.436872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.459560 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1396/2781] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:37 2022] PUT /identity/v3/projects/3fdf48ab6b994c72994b861fba4887fd/users/96c26d26a0af480ca9cbbd06502de729/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:37.473323 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.473792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.474168 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.504380 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] MFA Rules not processed for user `96c26d26a0af480ca9cbbd06502de729`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:37.505853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:37.540466 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:37.585255 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1386/2782] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:37.597073 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.599170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:37.667276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:37.685423 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8df974-3f00-4e5b-99b5-198f3a34532e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.692505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.693129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.693405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.693692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.702143 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.703799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.715276 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1397/2783] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:45.200812 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.214068 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.215642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.268564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78cd5f-87aa-49c7-b258-0105dc97e74e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.273356 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.274014 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.274286 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.274550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] PATH_INFO: `/v3/users/96c26d26a0af480ca9cbbd06502de729` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.275654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c26d26a0af480ca9cbbd06502de729)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.277562 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.282452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefad31-0058-4e0f-8a62-579966c28b72 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.287007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.287652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.287931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.288203 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] PATH_INFO: `/v3/users/b41f66a765384250a123e56e002e95aa` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.289356 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41f66a765384250a123e56e002e95aa)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.291332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.333828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c26d26a0af480ca9cbbd06502de729'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.343049 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c26d26a0af480ca9cbbd06502de729'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.343678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c26d26a0af480ca9cbbd06502de729'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.357337 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c26d26a0af480ca9cbbd06502de729'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.358160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b422c54-7689-4a7d-841e-9ac2ecd9f8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c26d26a0af480ca9cbbd06502de729'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.371832 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1387/2784] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:45 2022] DELETE /identity/v3/users/96c26d26a0af480ca9cbbd06502de729 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:45.376565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.376851 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.377124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.398002 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:45.399274 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.459283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:45.474828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41f66a765384250a123e56e002e95aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.475266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1388/2785] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:45.475546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41f66a765384250a123e56e002e95aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.484049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41f66a765384250a123e56e002e95aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.484689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41f66a765384250a123e56e002e95aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.487458 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.488838 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.497564 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-a05ddc9b-528b-49b7-b2e9-4c3cb56ce3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41f66a765384250a123e56e002e95aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:45.511373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1398/2786] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:45 2022] DELETE /identity/v3/users/b41f66a765384250a123e56e002e95aa => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:45.515996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.516483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.516754 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.537288 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:45.538940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.552666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b79da9-1934-4729-8235-af51304fbc2b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.602394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1399/2787] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:45.602626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.603244 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.603519 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.603817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.605600 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.612423 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.613819 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.618822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.620291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.622046 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:45.626285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96165f-34b7-4186-ad9a-646a4a733aaf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.630749 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1389/2788] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:02:45.630894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.631646 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.632126 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.632443 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.642921 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.644525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.660165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1400/2789] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:45.967732 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.969025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:45.986040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dbe0b-10d5-42b2-8fda-b34360137288 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.991218 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.991975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.992176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.992448 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] PATH_INFO: `/v3/projects/3fdf48ab6b994c72994b861fba4887fd` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.994042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdf48ab6b994c72994b861fba4887fd)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.996034 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.014007 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.015880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:46.030760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033576f5-17be-4f7b-8bae-42d84d47f9f1 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.036952 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.037607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.037953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.038452 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] PATH_INFO: `/v3/projects/4bb82227ea844514adac6edb21fbac3c` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.039667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb82227ea844514adac6edb21fbac3c)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.042507 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.058419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdf48ab6b994c72994b861fba4887fd', 'request_id': 'req-1982845a-09f0-47f2-bbd7-0fef13c803d2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.065420 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdf48ab6b994c72994b861fba4887fd', 'request_id': 'req-1982845a-09f0-47f2-bbd7-0fef13c803d2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.073981 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdf48ab6b994c72994b861fba4887fd', 'request_id': 'req-1982845a-09f0-47f2-bbd7-0fef13c803d2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.084676 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] The token cache is being invalidate because project 3fdf48ab6b994c72994b861fba4887fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:46.084995 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.085799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1982845a-09f0-47f2-bbd7-0fef13c803d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.087522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1390/2790] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:45 2022] DELETE /identity/v3/projects/3fdf48ab6b994c72994b861fba4887fd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:46.092098 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.092389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.092695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.094072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb82227ea844514adac6edb21fbac3c', 'request_id': 'req-b93a1847-71b9-4e49-9592-45a403a7caf9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.100477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb82227ea844514adac6edb21fbac3c', 'request_id': 'req-b93a1847-71b9-4e49-9592-45a403a7caf9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.113265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:46.114644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:46.116444 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb82227ea844514adac6edb21fbac3c', 'request_id': 'req-b93a1847-71b9-4e49-9592-45a403a7caf9'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.128999 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] The token cache is being invalidate because project 4bb82227ea844514adac6edb21fbac3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:46.129293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.129989 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-b93a1847-71b9-4e49-9592-45a403a7caf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:46.131500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1401/2791] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:46 2022] DELETE /identity/v3/projects/4bb82227ea844514adac6edb21fbac3c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:46.155467 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:46.187187 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1391/2792] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:02:46.195559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.195842 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.196118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.219196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:46.220561 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:46.230314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1402/2793] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:46.235645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.247001 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c0fab-7df5-40a0-8192-f172c9737121 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.252623 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.253269 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.253544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.253825 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.254507 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:46.254807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.256486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.273354 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1392/2794] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:46.275337 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.287216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799e71-b914-4612-9e8e-d83f380ddfac None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.292763 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.293418 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.293691 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.293995 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.294644 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.296891 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.329214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1403/2795] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:46.333734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.346163 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a1d-58c2-4b44-bba8-cf42c181f172 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.410130 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.410655 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.410966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.411257 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.411889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.414314 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.435585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1393/2796] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:46 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:46.440479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.451206 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f882b8-96c4-42e3-8bbf-e3dd577d875f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.456477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.457088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.457364 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.457631 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.458308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.459925 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.471342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1404/2797] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:46.475936 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.487195 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ea44-dd14-4c64-b085-9b1fa31c9e5e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.492834 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e34a2-c3e6-4baa-8df3-e0f210672ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.493449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e34a2-c3e6-4baa-8df3-e0f210672ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.493725 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e34a2-c3e6-4baa-8df3-e0f210672ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.494010 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e34a2-c3e6-4baa-8df3-e0f210672ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.494644 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e34a2-c3e6-4baa-8df3-e0f210672ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.496252 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e34a2-c3e6-4baa-8df3-e0f210672ec1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.507643 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1394/2798] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:02:46.512260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.522998 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3a531-b633-4b5d-97fc-e20aa559f91f admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.528484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.529157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.529438 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.529695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] PATH_INFO: `/v3/projects/aac87e28981846a6adb948e5689971ba/users/fed9a0f026a54b1eb65b4246c74ff645/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.545567 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac87e28981846a6adb948e5689971ba, user_id=fed9a0f026a54b1eb65b4246c74ff645, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.548469 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.565117 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1405/2799] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:46 2022] PUT /identity/v3/projects/aac87e28981846a6adb948e5689971ba/users/fed9a0f026a54b1eb65b4246c74ff645/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:46.576611 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.576903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.577175 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.608867 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] MFA Rules not processed for user `fed9a0f026a54b1eb65b4246c74ff645`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:46.610219 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:46.683149 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1395/2800] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:46.697066 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.698948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:46.781450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564dc8-14a3-4ee9-a1b4-b531eb076290 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.787328 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292e885-f977-47ab-9cb4-fe324721c72f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.787975 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292e885-f977-47ab-9cb4-fe324721c72f service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.788252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292e885-f977-47ab-9cb4-fe324721c72f service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.788517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292e885-f977-47ab-9cb4-fe324721c72f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.796300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:46.798626 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292e885-f977-47ab-9cb4-fe324721c72f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.800585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292e885-f977-47ab-9cb4-fe324721c72f service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.826547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1406/2801] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:47.049046 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:47.084410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:47.113757 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cab85-0624-48f9-b8a7-8b780cbd641a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:47.118522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:47.119157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.119473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.119743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] PATH_INFO: `/v3/users/fed9a0f026a54b1eb65b4246c74ff645` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.120924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed9a0f026a54b1eb65b4246c74ff645)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:47.123110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:47.171743 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed9a0f026a54b1eb65b4246c74ff645'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.182731 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed9a0f026a54b1eb65b4246c74ff645'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.183461 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed9a0f026a54b1eb65b4246c74ff645'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.197511 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed9a0f026a54b1eb65b4246c74ff645'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.198147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed9a0f026a54b1eb65b4246c74ff645'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.210502 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1396/2802] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:47 2022] DELETE /identity/v3/users/fed9a0f026a54b1eb65b4246c74ff645 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:47.215181 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.215489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.215761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.234651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:47.235818 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:47.301136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1407/2803] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:47.311315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:47.313285 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:47.373154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f44a2e-acab-4d6e-8687-48528df74233 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:47.377238 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824c9a1-b43b-4641-aab0-14aad473a5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:47.377899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c9a1-b43b-4641-aab0-14aad473a5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.378176 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c9a1-b43b-4641-aab0-14aad473a5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.378426 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c9a1-b43b-4641-aab0-14aad473a5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.387682 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824c9a1-b43b-4641-aab0-14aad473a5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:47.389114 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824c9a1-b43b-4641-aab0-14aad473a5b3 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:47.399887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1397/2804] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:47.691049 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:47.692554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:47.707675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccffe4-4623-45a4-b77c-09f4aa47a0fd None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:47.714104 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:47.714811 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.715096 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.715350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] PATH_INFO: `/v3/projects/aac87e28981846a6adb948e5689971ba` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.716747 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac87e28981846a6adb948e5689971ba)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:47.719281 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:47.770285 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac87e28981846a6adb948e5689971ba', 'request_id': 'req-4da0e40c-9aa4-4a1b-8662-f839123f320c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.776651 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac87e28981846a6adb948e5689971ba', 'request_id': 'req-4da0e40c-9aa4-4a1b-8662-f839123f320c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.785261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac87e28981846a6adb948e5689971ba', 'request_id': 'req-4da0e40c-9aa4-4a1b-8662-f839123f320c'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.796511 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] The token cache is being invalidate because project aac87e28981846a6adb948e5689971ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:47.796802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.797519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4da0e40c-9aa4-4a1b-8662-f839123f320c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:47.799153 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1408/2805] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:47 2022] DELETE /identity/v3/projects/aac87e28981846a6adb948e5689971ba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:02:47.804192 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.804495 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.804760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.825856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:47.827067 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:47.878813 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:47.898150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1398/2806] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:47.907413 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.907761 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.908098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.928341 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:47.929555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:47.938497 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1409/2807] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:47.943126 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:47.953451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d300-a4c3-4b4a-b769-509843a11261 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:47.959198 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:47.960091 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.960538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.960899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.961843 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:47.962325 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:47.964730 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:47.982849 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1399/2808] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:47.989180 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.002536 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8903b-ec16-421e-8aa3-62be14aeb0a8 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.008521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.009136 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.009437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.009705 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.010409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.012349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.051199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1410/2809] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:47 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:48.056234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.069024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4430e-e80c-4c91-9e5f-20dba40d97e7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.129154 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.129798 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.130085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.130358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.130990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.132889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.157472 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1400/2810] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:48 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:48.161813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.172454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464013f-1927-4859-bfc9-8cbb2155b720 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.178257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.179146 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.179571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.179844 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.182454 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.184323 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.196433 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1411/2811] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:48.200985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.212340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f0d61-83e3-455c-9934-60d4feaf4be9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.218355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dae06-f44f-49c4-be96-6429c32d1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.218954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dae06-f44f-49c4-be96-6429c32d1382 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.219224 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dae06-f44f-49c4-be96-6429c32d1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.219483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dae06-f44f-49c4-be96-6429c32d1382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.220112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dae06-f44f-49c4-be96-6429c32d1382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.221727 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dae06-f44f-49c4-be96-6429c32d1382 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.232807 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1401/2812] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:48.237240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.248004 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8d62e-aa2e-48d2-8dca-9b0ab05c387d admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.253987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.254685 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.254953 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.255222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] PATH_INFO: `/v3/projects/fd82dd247332483ebf95f331e839c450/users/f6ea7bf87d6f42f296ce0af91a9cb4c6/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.271045 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd82dd247332483ebf95f331e839c450, user_id=f6ea7bf87d6f42f296ce0af91a9cb4c6, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.273813 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.290963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1412/2813] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:48 2022] PUT /identity/v3/projects/fd82dd247332483ebf95f331e839c450/users/f6ea7bf87d6f42f296ce0af91a9cb4c6/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:48.302439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.302656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.303230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.335593 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] MFA Rules not processed for user `f6ea7bf87d6f42f296ce0af91a9cb4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:48.336848 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:48.406440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1402/2814] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:48.411601 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.430598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:48.481220 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1cf6-0662-4dee-bfdf-009889468b3e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.486277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.486905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.487183 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.487453 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.488214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.490193 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.517692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1413/2815] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:48 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:48.522332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.533595 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d51b3-45c9-497c-a4c3-cf30a9260d63 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.583629 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:48.598494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.599103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.599378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.599649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.600283 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.602250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.626659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1403/2816] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:48 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:48.630897 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.641618 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ff4a-1ffa-4115-845b-2bcd27343651 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.647579 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.648188 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.648463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.648732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.649399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.651059 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.661964 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1414/2817] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:48.666031 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.676440 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6463f8-4ef7-4c63-8354-0adaed2ea5cb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.681355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.682042 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.682320 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.682589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] PATH_INFO: `/v3/projects/e59d780113c64ac1a1570db93faf1151/users/fe5c695536b94b86a54f64570bcd6c87/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.698397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59d780113c64ac1a1570db93faf1151, user_id=fe5c695536b94b86a54f64570bcd6c87, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.701053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.716863 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1404/2818] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:48 2022] PUT /identity/v3/projects/e59d780113c64ac1a1570db93faf1151/users/fe5c695536b94b86a54f64570bcd6c87/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:48.721121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.731404 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7539-ff30-49e3-a79a-f7f5b648efb7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.802129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4319e-cb9b-437e-9525-e369f90f6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.802756 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4319e-cb9b-437e-9525-e369f90f6b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.803074 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4319e-cb9b-437e-9525-e369f90f6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.803366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4319e-cb9b-437e-9525-e369f90f6b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.804035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4319e-cb9b-437e-9525-e369f90f6b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.805674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4319e-cb9b-437e-9525-e369f90f6b5f admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.816149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1415/2819] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:48.820439 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.831445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9d851-ce55-4bd3-b2d2-43c07e5827c2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:48.836211 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:48.836827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.837100 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.837368 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] PATH_INFO: `/v3/projects/e59d780113c64ac1a1570db93faf1151/users/fe5c695536b94b86a54f64570bcd6c87/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.839353 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59d780113c64ac1a1570db93faf1151, user_id=fe5c695536b94b86a54f64570bcd6c87, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:48.842085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:48.853230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1405/2820] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:48 2022] PUT /identity/v3/projects/e59d780113c64ac1a1570db93faf1151/users/fe5c695536b94b86a54f64570bcd6c87/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:48.864584 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:48.864957 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:48.865412 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:48.896482 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] MFA Rules not processed for user `fe5c695536b94b86a54f64570bcd6c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:48.897889 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:48.968318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1416/2821] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:48.980658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:48.982783 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:49.044572 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ff92d-62fa-44d9-9448-332db4985f12 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:49.048560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d8ccc-0840-4393-b979-8458e48f06f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:49.049157 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8ccc-0840-4393-b979-8458e48f06f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.049429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8ccc-0840-4393-b979-8458e48f06f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.049696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8ccc-0840-4393-b979-8458e48f06f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.058964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d8ccc-0840-4393-b979-8458e48f06f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:49.060403 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d8ccc-0840-4393-b979-8458e48f06f3 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:49.070566 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1406/2822] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:48 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:49.214101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.227154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:49.277517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786329c-d864-468e-9d17-cab5675e7320 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:49.282932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:49.283582 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.283851 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.284115 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] PATH_INFO: `/v3/users/f6ea7bf87d6f42f296ce0af91a9cb4c6` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.285262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ea7bf87d6f42f296ce0af91a9cb4c6)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:49.287233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:49.339197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ea7bf87d6f42f296ce0af91a9cb4c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.339857 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ea7bf87d6f42f296ce0af91a9cb4c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.349435 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ea7bf87d6f42f296ce0af91a9cb4c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.350312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ea7bf87d6f42f296ce0af91a9cb4c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.367399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ea7bf87d6f42f296ce0af91a9cb4c6'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.380843 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1417/2823] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:49 2022] DELETE /identity/v3/users/f6ea7bf87d6f42f296ce0af91a9cb4c6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:49.385580 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.386122 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.386221 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.407165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:49.408355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:49.472736 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1407/2824] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:49.483174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.484708 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:49.547165 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debd3a8-25e1-413d-affb-d187ac13245b admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:49.550878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:49.551546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.552238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.552238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.561429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:49.563334 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:49.573113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1418/2825] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:49.859968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.861487 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:49.876796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27dcc2-99e7-49de-aed1-0b0235fed7bd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:49.881872 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:49.882524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.882815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.883083 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] PATH_INFO: `/v3/projects/fd82dd247332483ebf95f331e839c450` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.884279 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd82dd247332483ebf95f331e839c450)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:49.886295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:49.928962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:49.935844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd82dd247332483ebf95f331e839c450', 'request_id': 'req-4982ec2a-ee4a-453a-b65e-b73748e0507f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.944095 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd82dd247332483ebf95f331e839c450', 'request_id': 'req-4982ec2a-ee4a-453a-b65e-b73748e0507f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.952964 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd82dd247332483ebf95f331e839c450', 'request_id': 'req-4982ec2a-ee4a-453a-b65e-b73748e0507f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.963296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] The token cache is being invalidate because project fd82dd247332483ebf95f331e839c450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:49.963578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.964422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:49.965937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1408/2826] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:49 2022] DELETE /identity/v3/projects/fd82dd247332483ebf95f331e839c450 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:49.970202 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.980426 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcecc2-416f-4e9b-8417-3998a2140b07 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.012709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:50.046550 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.047225 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.047502 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.047770 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] PATH_INFO: `/v3/users/fe5c695536b94b86a54f64570bcd6c87` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.048944 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5c695536b94b86a54f64570bcd6c87)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.050905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.113313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5c695536b94b86a54f64570bcd6c87'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.114389 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5c695536b94b86a54f64570bcd6c87'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.125800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5c695536b94b86a54f64570bcd6c87'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.126456 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5c695536b94b86a54f64570bcd6c87'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.138740 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-777b847a-cb20-49d3-bf27-0308087bc383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5c695536b94b86a54f64570bcd6c87'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.150559 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1419/2827] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:02:49 2022] DELETE /identity/v3/users/fe5c695536b94b86a54f64570bcd6c87 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:50.427444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.429079 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:50.443359 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ec2a-ee4a-453a-b65e-b73748e0507f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.504965 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.505624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.505926 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.506304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] PATH_INFO: `/v3/projects/e59d780113c64ac1a1570db93faf1151` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.507531 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59d780113c64ac1a1570db93faf1151)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.509451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.557666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59d780113c64ac1a1570db93faf1151', 'request_id': 'req-e41be914-3ec3-42f9-be02-9a7ed1f249fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.564304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59d780113c64ac1a1570db93faf1151', 'request_id': 'req-e41be914-3ec3-42f9-be02-9a7ed1f249fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.573470 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59d780113c64ac1a1570db93faf1151', 'request_id': 'req-e41be914-3ec3-42f9-be02-9a7ed1f249fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.586610 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] The token cache is being invalidate because project e59d780113c64ac1a1570db93faf1151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:02:50.586903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.587654 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e41be914-3ec3-42f9-be02-9a7ed1f249fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:02:50.589358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1409/2828] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:02:50 2022] DELETE /identity/v3/projects/e59d780113c64ac1a1570db93faf1151 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:50.594798 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.595280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.595407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.618713 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:50.620170 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:50.680063 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1420/2829] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:50.688452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.688729 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.688997 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.709797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:50.710987 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:50.719696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1410/2830] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:50.724154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.734240 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19c45-b653-409c-b151-7ea1353b4391 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.739432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.740024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.740350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.740614 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.741248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81483) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:50.741545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.743172 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.754554 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1421/2831] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:02:50.759158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.770397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56cf7f-4a5d-4430-bea2-8597077e01c7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.776948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.777612 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.777928 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.778193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.778828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.780861 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.814910 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1411/2832] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:50 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:50.821375 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.831829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223babfe-3a2a-4992-81d9-abdc773a9bf7 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.870378 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:50.890056 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.890671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.890948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.891217 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.891845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.893784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.917366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1422/2833] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:50 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:50.921696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.932303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a661c-621c-40be-9c1c-80132a0c6666 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.937028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.937695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.938375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.938642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.939277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.940887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.951090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1412/2834] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:50.955215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.965734 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf2d1-4309-414f-af18-a04700e8e4c6 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.971630 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0358-37ca-40bc-b6c9-f478cb5f7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.972265 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0358-37ca-40bc-b6c9-f478cb5f7ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.972546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0358-37ca-40bc-b6c9-f478cb5f7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.972817 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0358-37ca-40bc-b6c9-f478cb5f7ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.973479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d0358-37ca-40bc-b6c9-f478cb5f7ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.975133 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d0358-37ca-40bc-b6c9-f478cb5f7ef8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.985977 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1423/2835] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:50.990207 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.000680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8811-7bb3-4ceb-b157-756fca0b7fb0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.005378 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.006058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.006334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.006605 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] PATH_INFO: `/v3/projects/1841a41ff21e4962be3677d199dfb727/users/718cea8bf59c481595f57946e805e6ca/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.021038 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1841a41ff21e4962be3677d199dfb727, user_id=718cea8bf59c481595f57946e805e6ca, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.023747 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.026769 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:51.042275 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1413/2836] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:50 2022] PUT /identity/v3/projects/1841a41ff21e4962be3677d199dfb727/users/718cea8bf59c481595f57946e805e6ca/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:51.052751 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.053080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.053355 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.081669 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] MFA Rules not processed for user `718cea8bf59c481595f57946e805e6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:51.083175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:51.157605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1424/2837] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:51.162618 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.227118 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786cebe-735c-4106-bb5b-d220b8bf7343 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.232115 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.232724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.232999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.233265 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.233961 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.235933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.265117 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1414/2838] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:02:51 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:51.270768 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.282932 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b5769-502d-47c2-bd55-5386ffbe9fdf None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.349238 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.349955 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.350258 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.350659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] PATH_INFO: `/v3/users` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.351308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.353255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.376427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1425/2839] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:02:51 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:02:51.380558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.391096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850958-b7e4-42f3-aca7-f4171dfb5f79 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.395898 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.396509 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.396777 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.397041 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.397680 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.399322 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.409829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1415/2840] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:51.414420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.425057 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8e402-b4a5-44f8-be27-1acc00c7a013 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.430201 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.430918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.431197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.431468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] PATH_INFO: `/v3/projects/4d4fc6df643948868b429ace6beaebbf/users/9974910e4ce440d0963950869545395a/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.447586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4fc6df643948868b429ace6beaebbf, user_id=9974910e4ce440d0963950869545395a, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.450293 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.465703 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1426/2841] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:51 2022] PUT /identity/v3/projects/4d4fc6df643948868b429ace6beaebbf/users/9974910e4ce440d0963950869545395a/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:51.470412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.480483 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d18e-91d6-4199-997c-a0b76dde0c65 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.550796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c50d-5354-4b1a-be13-955df074c16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.551412 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c50d-5354-4b1a-be13-955df074c16b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.551684 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c50d-5354-4b1a-be13-955df074c16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.551950 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c50d-5354-4b1a-be13-955df074c16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.552594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339c50d-5354-4b1a-be13-955df074c16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.554373 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339c50d-5354-4b1a-be13-955df074c16b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.564554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1416/2842] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:02:51.571157 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.587294 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0ce25-a379-4c95-90e9-3dcaacb9a9a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.595546 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.596175 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.596458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.596736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] PATH_INFO: `/v3/projects/4d4fc6df643948868b429ace6beaebbf/users/9974910e4ce440d0963950869545395a/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.599010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4fc6df643948868b429ace6beaebbf, user_id=9974910e4ce440d0963950869545395a, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.601666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.608425 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:51.613935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1427/2843] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:02:51 2022] PUT /identity/v3/projects/4d4fc6df643948868b429ace6beaebbf/users/9974910e4ce440d0963950869545395a/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:51.625853 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.626152 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.626418 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.654828 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] MFA Rules not processed for user `9974910e4ce440d0963950869545395a`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:51.656065 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:51.710131 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:51.730193 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1417/2844] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:02:51.742166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.744101 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:51.806909 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c77d9-9d20-40dc-b686-3e2e313238a0 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.811420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b53e-62e2-4409-acd7-88f664a5b143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.812024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b53e-62e2-4409-acd7-88f664a5b143 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.812295 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b53e-62e2-4409-acd7-88f664a5b143 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.812605 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b53e-62e2-4409-acd7-88f664a5b143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.822588 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b53e-62e2-4409-acd7-88f664a5b143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.824052 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b53e-62e2-4409-acd7-88f664a5b143 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.833712 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1428/2845] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:51.910521 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.921280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dfff-6361-4011-bcf8-a629e311781b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.925856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.926465 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.926760 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.927026 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.984027 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.985590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.994662 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1418/2846] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:02:54.344659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7dc1-6571-4f3c-83c7-b62dc3ff15dc None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.345236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7dc1-6571-4f3c-83c7-b62dc3ff15dc None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.345236 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7dc1-6571-4f3c-83c7-b62dc3ff15dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.365397 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-842b7dc1-6571-4f3c-83c7-b62dc3ff15dc None None] MFA Rules not processed for user `951b4d24f5c4460db22218f94ded0c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:54.366709 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-842b7dc1-6571-4f3c-83c7-b62dc3ff15dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:54.423665 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1429/2847] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:01.990486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=32 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:02.053555 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:02.119709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36380-09d0-47e6-8ecb-d901db9fba25 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:02.125023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:02.125678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:02.125937 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:02.126232 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] PATH_INFO: `/v3/users/718cea8bf59c481595f57946e805e6ca` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:02.127384 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=718cea8bf59c481595f57946e805e6ca)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:02.129296 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:02.177150 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718cea8bf59c481595f57946e805e6ca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.185494 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718cea8bf59c481595f57946e805e6ca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.186183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718cea8bf59c481595f57946e805e6ca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.198875 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718cea8bf59c481595f57946e805e6ca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.199505 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718cea8bf59c481595f57946e805e6ca'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.212578 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1419/2848] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:02 2022] DELETE /identity/v3/users/718cea8bf59c481595f57946e805e6ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:02.217342 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:02.217731 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:02.217934 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:02.238587 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:02.239996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:02.303931 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1430/2849] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:02.314632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:02.316181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:02.377226 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023c1c-a6b7-4120-a8a9-1b40bce3d5cd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:02.380803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:02.381417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:02.381696 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:02.382037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:02.391452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:02.392887 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:02.403058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1420/2850] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:02.684361 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:02.685878 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:02.698903 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdb757-080a-4b48-920e-adbfb5ba07ae None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:02.705907 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:02.707196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:02.707655 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:02.707936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] PATH_INFO: `/v3/projects/1841a41ff21e4962be3677d199dfb727` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:02.709309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1841a41ff21e4962be3677d199dfb727)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:02.711442 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:02.757823 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:02.762430 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1841a41ff21e4962be3677d199dfb727', 'request_id': 'req-4b4010e7-7186-4cf4-a13f-61c9176f5126'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.768828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1841a41ff21e4962be3677d199dfb727', 'request_id': 'req-4b4010e7-7186-4cf4-a13f-61c9176f5126'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.777664 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1841a41ff21e4962be3677d199dfb727', 'request_id': 'req-4b4010e7-7186-4cf4-a13f-61c9176f5126'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.792436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] The token cache is being invalidate because project 1841a41ff21e4962be3677d199dfb727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:02.792719 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.793432 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.795060 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1431/2851] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:02 2022] DELETE /identity/v3/projects/1841a41ff21e4962be3677d199dfb727 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:02.799333 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:02.809691 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae802-61df-477a-9829-db12d2aabc98 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:02.829551 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:02.875598 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:02.876246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:02.876522 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:02.876790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] PATH_INFO: `/v3/users/9974910e4ce440d0963950869545395a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:02.877998 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9974910e4ce440d0963950869545395a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:02.879962 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:02.936693 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9974910e4ce440d0963950869545395a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.945581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9974910e4ce440d0963950869545395a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.946486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9974910e4ce440d0963950869545395a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.960515 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9974910e4ce440d0963950869545395a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.961230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c350ab62-bb83-40c3-a58e-38f1733950e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9974910e4ce440d0963950869545395a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:02.974331 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1421/2852] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:02 2022] DELETE /identity/v3/users/9974910e4ce440d0963950869545395a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:03.268984 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.270689 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:03.284483 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4010e7-7186-4cf4-a13f-61c9176f5126 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.343369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.344035 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.344312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.344576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] PATH_INFO: `/v3/projects/4d4fc6df643948868b429ace6beaebbf` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.345698 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4fc6df643948868b429ace6beaebbf)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.347659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.393912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4fc6df643948868b429ace6beaebbf', 'request_id': 'req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:03.400021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4fc6df643948868b429ace6beaebbf', 'request_id': 'req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:03.418966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4fc6df643948868b429ace6beaebbf', 'request_id': 'req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:03.431196 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] The token cache is being invalidate because project 4d4fc6df643948868b429ace6beaebbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:03.431485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:03.432120 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-ebf5dda0-1b47-4f89-be95-f8d3c7fe432d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:03.433642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1432/2853] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:03 2022] DELETE /identity/v3/projects/4d4fc6df643948868b429ace6beaebbf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:03.439752 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.440309 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.440476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.461695 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:03.462903 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:03.524449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1422/2854] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:03.532928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.533214 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.533479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.555868 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:03.557113 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:03.565640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1433/2855] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:03.570291 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.580021 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339b664-47da-4b14-8ead-00eec735dbbb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.584490 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.585220 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.585488 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.585751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.586417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:03:03.586710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.588315 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.599856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1423/2856] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:03:03.604692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.618255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa4dc-05ae-4b96-91ad-912ce4c319a2 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.627517 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.628410 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.628801 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.629194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.630200 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.632821 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.665753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1434/2857] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:03:03 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:03:03.671474 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.682780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6c8e-1537-4348-b294-9324736c9e0a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.712649 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:03.746911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.747520 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.747794 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.748062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.748718 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.750702 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.777456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1424/2858] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:03:03 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:03.782592 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.799370 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322937-bd33-40bb-affc-78f51f346d4e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.806622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.807230 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.807495 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.807777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.808427 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.810081 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.821083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1435/2859] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:03.825898 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.836999 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12a114-a43d-4119-b887-7df4e81664bd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.842352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573a9c-6dda-4c94-b09a-b83c553363c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.842963 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573a9c-6dda-4c94-b09a-b83c553363c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.843235 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573a9c-6dda-4c94-b09a-b83c553363c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.843503 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573a9c-6dda-4c94-b09a-b83c553363c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.844145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573a9c-6dda-4c94-b09a-b83c553363c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.845945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573a9c-6dda-4c94-b09a-b83c553363c7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.858589 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1425/2860] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:03.862954 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:03.873233 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a9a2-0298-4bc8-bddf-56740bf62379 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:03.878991 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:03.879649 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.879928 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.880187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] PATH_INFO: `/v3/projects/ff98d7680d8f47e68d82ced50ded6a40/users/5360b10d36634f3a8b63cb5dfce4ce0b/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.895250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff98d7680d8f47e68d82ced50ded6a40, user_id=5360b10d36634f3a8b63cb5dfce4ce0b, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:03.897992 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:03.908036 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:03.915024 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1436/2861] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:03 2022] PUT /identity/v3/projects/ff98d7680d8f47e68d82ced50ded6a40/users/5360b10d36634f3a8b63cb5dfce4ce0b/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:03:03.925953 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.926246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.926541 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.956132 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] MFA Rules not processed for user `5360b10d36634f3a8b63cb5dfce4ce0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:03.957355 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:04.026978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1426/2862] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:03:04.031874 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.094257 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622805-6c49-4109-9e3d-dc67d3881813 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.099666 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.100267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.100525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.100886 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.101520 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.103464 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.134022 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1437/2863] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:03:04 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:04.138554 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.150096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37758f0-eeac-4537-b1f8-b29983bb5e9e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.208062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.212659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.212659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.212659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.212659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.212659 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.237790 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1427/2864] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:03:04 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:04.242145 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.252647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ee574-858a-47f3-9145-96d743579282 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.257484 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.258118 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.258399 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.258674 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.259310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.260966 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.271422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1438/2865] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:04.275486 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.286133 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a56b58-a844-4d44-8365-13e9473b0680 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.291540 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.292203 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.292481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.292755 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] PATH_INFO: `/v3/projects/da53353dd5624529bf7e6e2c56689035/users/e473a5c8f6ea47698ae0c7a705e645d5/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.310259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da53353dd5624529bf7e6e2c56689035, user_id=e473a5c8f6ea47698ae0c7a705e645d5, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.312885 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.328689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1428/2866] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:04 2022] PUT /identity/v3/projects/da53353dd5624529bf7e6e2c56689035/users/e473a5c8f6ea47698ae0c7a705e645d5/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:03:04.332832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.342946 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079d0c2-943c-4168-8721-6e7989243940 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.407607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc2cd6-97b2-462f-8a93-f49891e44b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.408373 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2cd6-97b2-462f-8a93-f49891e44b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.408658 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2cd6-97b2-462f-8a93-f49891e44b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.408951 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2cd6-97b2-462f-8a93-f49891e44b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.409962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc2cd6-97b2-462f-8a93-f49891e44b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.412500 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc2cd6-97b2-462f-8a93-f49891e44b49 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.423332 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1439/2867] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:04.428591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.434456 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:04.441413 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba20f5-7500-4f46-84a6-fd8529e4b3f2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.447127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.447793 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.448068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.448340 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] PATH_INFO: `/v3/projects/da53353dd5624529bf7e6e2c56689035/users/e473a5c8f6ea47698ae0c7a705e645d5/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.450324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da53353dd5624529bf7e6e2c56689035, user_id=e473a5c8f6ea47698ae0c7a705e645d5, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.452986 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.463745 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1429/2868] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:04 2022] PUT /identity/v3/projects/da53353dd5624529bf7e6e2c56689035/users/e473a5c8f6ea47698ae0c7a705e645d5/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:04.534672 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.535176 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.535635 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.572458 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] MFA Rules not processed for user `e473a5c8f6ea47698ae0c7a705e645d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:04.573597 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:04.635318 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:04.646940 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1440/2869] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:04.659769 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.661576 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:04.722954 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eace6e2-e9ca-4f0b-af08-ddb8483bf56e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.727303 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.727916 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.728194 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.728460 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.737831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.739266 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.749477 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1430/2870] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:04.824732 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.834824 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673bdd-2120-4adb-bf01-c7c9a8092520 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.839234 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206664c6-f232-48f8-be1b-33e32e77bb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.839853 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206664c6-f232-48f8-be1b-33e32e77bb3b service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.840128 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206664c6-f232-48f8-be1b-33e32e77bb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.840424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206664c6-f232-48f8-be1b-33e32e77bb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.898923 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206664c6-f232-48f8-be1b-33e32e77bb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.901062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206664c6-f232-48f8-be1b-33e32e77bb3b service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.912477 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1441/2871] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:05.202156 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:05.266869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9dbd7-1b02-40fa-be55-2d9ef03d14de service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:05.271678 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:05.272326 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:05.272631 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:05.272905 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] PATH_INFO: `/v3/users/5360b10d36634f3a8b63cb5dfce4ce0b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:05.274106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5360b10d36634f3a8b63cb5dfce4ce0b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:05.276037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:05.329264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5360b10d36634f3a8b63cb5dfce4ce0b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.340352 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5360b10d36634f3a8b63cb5dfce4ce0b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.341037 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5360b10d36634f3a8b63cb5dfce4ce0b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.353596 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5360b10d36634f3a8b63cb5dfce4ce0b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.354200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5360b10d36634f3a8b63cb5dfce4ce0b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.366390 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1431/2872] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:05 2022] DELETE /identity/v3/users/5360b10d36634f3a8b63cb5dfce4ce0b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:05.371021 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:05.371485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:05.371585 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:05.391407 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:05.392604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:05.455996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1442/2873] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:05.466449 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:05.468151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:05.482425 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:05.530594 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20a0b-bdc2-433f-a211-8b0525371643 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:05.535096 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:05.535709 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:05.535985 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:05.536254 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:05.546214 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:05.547656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:05.557438 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1432/2874] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:05.880577 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:05.883083 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:05.898085 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60914b09-a429-463a-a3a0-722e007d62a9 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:05.904088 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:05.904755 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:05.905675 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:05.905986 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] PATH_INFO: `/v3/projects/ff98d7680d8f47e68d82ced50ded6a40` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:05.907403 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff98d7680d8f47e68d82ced50ded6a40)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:05.909362 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:05.961144 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff98d7680d8f47e68d82ced50ded6a40', 'request_id': 'req-0f5d0b90-10da-4b88-abc0-c497d06fa36a'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.967394 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff98d7680d8f47e68d82ced50ded6a40', 'request_id': 'req-0f5d0b90-10da-4b88-abc0-c497d06fa36a'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.976385 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff98d7680d8f47e68d82ced50ded6a40', 'request_id': 'req-0f5d0b90-10da-4b88-abc0-c497d06fa36a'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.986622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] The token cache is being invalidate because project ff98d7680d8f47e68d82ced50ded6a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:05.986905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.987501 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:05.988987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1443/2875] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:05 2022] DELETE /identity/v3/projects/ff98d7680d8f47e68d82ced50ded6a40 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:05.993237 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:06.003306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a671-fb0b-4882-8937-9d67e29ceebf service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:06.065024 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:06.065675 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.066003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.066278 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] PATH_INFO: `/v3/users/e473a5c8f6ea47698ae0c7a705e645d5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.067468 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e473a5c8f6ea47698ae0c7a705e645d5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:06.069422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:06.123097 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e473a5c8f6ea47698ae0c7a705e645d5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.132399 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e473a5c8f6ea47698ae0c7a705e645d5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.133058 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e473a5c8f6ea47698ae0c7a705e645d5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.145452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e473a5c8f6ea47698ae0c7a705e645d5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.146106 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3b6fbcea-b073-47a6-aec9-19c5ec2ca672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e473a5c8f6ea47698ae0c7a705e645d5'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.158376 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1433/2876] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:05 2022] DELETE /identity/v3/users/e473a5c8f6ea47698ae0c7a705e645d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:06.443392 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:06.445232 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:06.458758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d0b90-10da-4b88-abc0-c497d06fa36a admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:06.473918 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:06.521002 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:06.521652 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.521988 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.522339 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] PATH_INFO: `/v3/projects/da53353dd5624529bf7e6e2c56689035` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.523474 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da53353dd5624529bf7e6e2c56689035)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:06.525460 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:06.574324 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da53353dd5624529bf7e6e2c56689035', 'request_id': 'req-822f663f-81df-4153-bc70-173149062ee5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.580300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da53353dd5624529bf7e6e2c56689035', 'request_id': 'req-822f663f-81df-4153-bc70-173149062ee5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.589344 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da53353dd5624529bf7e6e2c56689035', 'request_id': 'req-822f663f-81df-4153-bc70-173149062ee5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.600333 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] The token cache is being invalidate because project da53353dd5624529bf7e6e2c56689035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:06.600622 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.601330 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-822f663f-81df-4153-bc70-173149062ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:06.602901 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1444/2877] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:06 2022] DELETE /identity/v3/projects/da53353dd5624529bf7e6e2c56689035 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:06.608141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.608665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.608665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.630561 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:06.631948 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:06.661073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:06.697174 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1434/2878] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:06.705309 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.705583 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.705875 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.725792 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:06.727042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:06.735556 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1445/2879] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:03:06.741750 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:06.751882 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807200-55b5-4a8b-a24b-7e9d8d8164f1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:06.756782 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:06.757386 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.757821 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.758082 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.758726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:03:06.759025 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:06.760632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:06.772679 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1435/2880] 10.222.0.75 () {58 vars in 1153 bytes} [Wed Aug 31 11:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:03:06.778929 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:06.791996 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2e44-a541-4599-92cf-a126e95c65e0 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:06.798562 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:06.799163 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.799437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.799701 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.800322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:06.802310 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:06.834087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1446/2881] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:03:06 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:06.838665 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:06.848974 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda9bc-6f72-451e-9ce8-d02696fa4203 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:06.907476 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:06.908005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.908281 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.908550 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.909183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:06.911109 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:06.947707 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1436/2882] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:03:06 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:06.952280 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:06.964199 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c5dd-b272-4d73-9e11-513cad9ac665 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:06.969401 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:06.970097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.970487 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.970852 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.971571 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:06.973277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:06.984950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1447/2883] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:03:06.989441 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.000234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9150e9-1bec-48cd-9438-887fbb28d24e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.005262 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e758-7786-4af4-ae2c-d3ef5c58c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.005927 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e758-7786-4af4-ae2c-d3ef5c58c1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.006200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e758-7786-4af4-ae2c-d3ef5c58c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.006482 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e758-7786-4af4-ae2c-d3ef5c58c1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.007129 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6e758-7786-4af4-ae2c-d3ef5c58c1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.008800 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6e758-7786-4af4-ae2c-d3ef5c58c1ca admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.020110 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1437/2884] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:07.024512 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.035072 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee66c2c-bbd9-4343-a4e7-fbb7ad0dbfe8 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.039911 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.040648 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.041003 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.041366 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] PATH_INFO: `/v3/projects/028034eba1ce4b2198b864ee3f64c70d/users/179bf2fa9d794621b81b46e7a25fe919/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.056710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028034eba1ce4b2198b864ee3f64c70d, user_id=179bf2fa9d794621b81b46e7a25fe919, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.059417 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.074815 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1448/2885] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:07 2022] PUT /identity/v3/projects/028034eba1ce4b2198b864ee3f64c70d/users/179bf2fa9d794621b81b46e7a25fe919/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:07.086567 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.086856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.087124 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.115307 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] MFA Rules not processed for user `179bf2fa9d794621b81b46e7a25fe919`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:07.116524 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:07.193319 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1438/2886] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:07.198752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.253758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:07.273273 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aef4e-e249-4d8a-94dd-b6af0c95ab70 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.278062 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.278678 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.278950 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.279219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.279839 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.281760 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.310899 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1449/2887] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:07.316748 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.327899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c30c-9c7c-4b3f-bac3-5c3459855144 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.355145 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:07.389799 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.390430 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.390705 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.390978 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.391602 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.393523 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.421724 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1439/2888] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:07.422997 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.433420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778499-14ac-4e4b-b849-a6e523003188 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.438580 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.439184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.439463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.439736 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.440398 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.442034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.452920 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1450/2889] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:07.457538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.467975 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f912bc1-06c4-46bc-abae-13a4d6580d4c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.474020 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1b538-7d7e-4584-beb1-99032e4189e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.474797 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1b538-7d7e-4584-beb1-99032e4189e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.475141 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1b538-7d7e-4584-beb1-99032e4189e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.475500 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1b538-7d7e-4584-beb1-99032e4189e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.476263 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1b538-7d7e-4584-beb1-99032e4189e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.478004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1b538-7d7e-4584-beb1-99032e4189e5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.488744 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1440/2890] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:03:07.493130 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.503450 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6925d-2e2c-4c54-bd59-5a30e449b8a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.508322 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.508973 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.509250 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.509525 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] PATH_INFO: `/v3/projects/7e106c5a0ce64f04b505c8b439ab45d3/users/cefa1baa3be7450f9a440da517350170/roles/8d8fadd4e1414e3da426c068de39430b` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.525278 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e106c5a0ce64f04b505c8b439ab45d3, user_id=cefa1baa3be7450f9a440da517350170, role_id=8d8fadd4e1414e3da426c068de39430b)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.527967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.547058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1451/2891] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:07 2022] PUT /identity/v3/projects/7e106c5a0ce64f04b505c8b439ab45d3/users/cefa1baa3be7450f9a440da517350170/roles/8d8fadd4e1414e3da426c068de39430b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:07.557639 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84027-9140-4191-b781-40da85e0e997 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.557956 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84027-9140-4191-b781-40da85e0e997 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.558228 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84027-9140-4191-b781-40da85e0e997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.588966 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dda84027-9140-4191-b781-40da85e0e997 None None] MFA Rules not processed for user `cefa1baa3be7450f9a440da517350170`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:07.590227 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dda84027-9140-4191-b781-40da85e0e997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:07.656739 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1441/2892] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:07.661625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.730102 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c466a73-4183-4a00-b61d-d383caa33869 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.735894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.736545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.736809 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.737071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.737793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.739882 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.768607 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1452/2893] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:07.775170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84027-9140-4191-b781-40da85e0e997 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.786304 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84027-9140-4191-b781-40da85e0e997 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.846230 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.846865 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.847142 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.847410 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.848043 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.849996 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.873306 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1442/2894] 10.222.0.75 () {60 vars in 1144 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:07.877687 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.888393 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ea86-be15-47c4-b1b5-cf8417e1bc7e admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.894092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.894692 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.894963 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.895221 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.895872 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.897704 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.908603 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1453/2895] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:03:07.913068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.923829 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6301527-708c-473a-af2b-22e40182314d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.929512 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.930189 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.930463 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.930726 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] PATH_INFO: `/v3/projects/a7b93d911f734aed9ed89b842bf4b766/users/ae17d692596c43009421b7a6e06cfc29/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.947517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b93d911f734aed9ed89b842bf4b766, user_id=ae17d692596c43009421b7a6e06cfc29, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.950294 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.967170 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1443/2896] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:07 2022] PUT /identity/v3/projects/a7b93d911f734aed9ed89b842bf4b766/users/ae17d692596c43009421b7a6e06cfc29/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:07.971314 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.981681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a6c3-69a5-412b-9030-79de2aa281a5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:08.036777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6b030-3b23-4b1a-bd24-17f1a189d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:08.037387 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b030-3b23-4b1a-bd24-17f1a189d4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:08.037667 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b030-3b23-4b1a-bd24-17f1a189d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:08.037967 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b030-3b23-4b1a-bd24-17f1a189d4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:08.038615 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6b030-3b23-4b1a-bd24-17f1a189d4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:08.040291 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6b030-3b23-4b1a-bd24-17f1a189d4c1 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:08.051547 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1454/2897] 10.222.0.75 () {58 vars in 1122 bytes} [Wed Aug 31 11:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:03:08.056911 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:08.062772 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:08.069645 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0f9f8-1913-47c0-bc3f-e07f6e7d4133 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:08.074728 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:08.075375 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:08.075656 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:08.075933 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] PATH_INFO: `/v3/projects/a7b93d911f734aed9ed89b842bf4b766/users/ae17d692596c43009421b7a6e06cfc29/roles/3220c969e78d4e839bfa6b8c6235cd2b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:08.077939 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b93d911f734aed9ed89b842bf4b766, user_id=ae17d692596c43009421b7a6e06cfc29, role_id=3220c969e78d4e839bfa6b8c6235cd2b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:08.080587 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:08.091640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1444/2898] 10.222.0.75 () {60 vars in 1483 bytes} [Wed Aug 31 11:03:08 2022] PUT /identity/v3/projects/a7b93d911f734aed9ed89b842bf4b766/users/ae17d692596c43009421b7a6e06cfc29/roles/3220c969e78d4e839bfa6b8c6235cd2b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:08.102190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:08.102478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:08.102730 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:08.110522 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:08.136793 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] MFA Rules not processed for user `ae17d692596c43009421b7a6e06cfc29`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:08.138040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:08.212167 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1455/2899] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:03:08.223818 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:08.225606 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:08.284989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9b0e-8e2e-4776-b6ac-b4c702535372 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:08.288835 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:08.289450 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:08.289723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:08.290023 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:08.346066 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:08.347508 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:08.356367 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1445/2900] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:09.899009 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:09.900762 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:09.913752 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc9c0-96e4-4abb-b3fd-9b13acbcb44a None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:09.917804 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:09.918429 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:09.918710 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:09.918980 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:09.982116 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:09.984151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:09.996515 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1456/2901] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:10.578581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:10.587666 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12f8af-dbab-4eb7-96cf-b020ecfbf6ea service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:10.592339 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52dcd18d699460b8a4d298a381a35d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:10.592968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:10.593270 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:10.593517 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:10.605004 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:10.606462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:10.616565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1446/2902] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:13.211573 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:13.213166 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:13.272260 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bab3-ecfc-417d-9754-4ff083a4bd32 service cinder] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:13.276769 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:13.277514 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:13.277832 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:13.278111 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:13.283368 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:13.337097 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=100 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:13.366604 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:13.368058 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:13.378422 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1457/2903] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:13.548890 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:13.550481 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:13.563196 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c3d7d-1f02-4b14-acd1-29664891de0d service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:13.567197 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:13.567796 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:13.568068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:13.568332 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:13.570064 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:13.636147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:13.637687 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398334ff-ea48-48a9-9345-4df3ccace778 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:13.648625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1447/2904] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:14.583468 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:14.659797 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979a02-4cbd-4886-971d-34bab8650394 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:14.664347 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:14.665025 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:14.665340 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:14.665539 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] PATH_INFO: `/v3/users/179bf2fa9d794621b81b46e7a25fe919` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:14.666892 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179bf2fa9d794621b81b46e7a25fe919)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:14.668782 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:14.735962 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179bf2fa9d794621b81b46e7a25fe919'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:14.736682 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179bf2fa9d794621b81b46e7a25fe919'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:14.745445 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179bf2fa9d794621b81b46e7a25fe919'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:14.746374 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179bf2fa9d794621b81b46e7a25fe919'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:14.762255 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179bf2fa9d794621b81b46e7a25fe919'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:14.775489 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1458/2905] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:14 2022] DELETE /identity/v3/users/179bf2fa9d794621b81b46e7a25fe919 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:14.779924 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:14.780454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:14.780454 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:14.802357 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] MFA Rules not processed for user `bd54da1432894173a79d520df35ac9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:14.803585 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:14.835565 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:14.878316 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1448/2906] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:03:14.889496 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:14.891528 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:14.958772 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a2f3-a691-4d6c-a6ee-42274f72f647 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:14.963277 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:14.964105 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:14.964485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:14.964859 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:14.976602 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:14.978289 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:14.998080 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1459/2907] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:15.309280 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:15.311173 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:15.324040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580c7f-419c-42e4-812c-f6e3e3be2001 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:15.339583 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:15.340324 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:15.341464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:15.342422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] PATH_INFO: `/v3/projects/028034eba1ce4b2198b864ee3f64c70d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:15.343155 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028034eba1ce4b2198b864ee3f64c70d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:15.346073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:15.407533 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028034eba1ce4b2198b864ee3f64c70d', 'request_id': 'req-d82bf535-c591-467f-989f-1cb647c77805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.414328 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028034eba1ce4b2198b864ee3f64c70d', 'request_id': 'req-d82bf535-c591-467f-989f-1cb647c77805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.426205 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028034eba1ce4b2198b864ee3f64c70d', 'request_id': 'req-d82bf535-c591-467f-989f-1cb647c77805'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.439947 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] The token cache is being invalidate because project 028034eba1ce4b2198b864ee3f64c70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:15.440222 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.440892 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.442444 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1449/2908] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:15 2022] DELETE /identity/v3/projects/028034eba1ce4b2198b864ee3f64c70d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:15.446880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:15.452683 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:15.459647 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb1b62-19fe-4b82-8a5b-ac59332050d5 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:15.555660 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:15.556248 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:15.556521 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:15.556794 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] PATH_INFO: `/v3/users/cefa1baa3be7450f9a440da517350170` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:15.557985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefa1baa3be7450f9a440da517350170)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:15.563758 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:15.632858 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefa1baa3be7450f9a440da517350170'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.634151 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefa1baa3be7450f9a440da517350170'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.645369 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefa1baa3be7450f9a440da517350170'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.646092 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefa1baa3be7450f9a440da517350170'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.661880 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefa1baa3be7450f9a440da517350170'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:15.675478 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1460/2909] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:15 2022] DELETE /identity/v3/users/cefa1baa3be7450f9a440da517350170 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:16.114147 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:16.115837 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:16.129591 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf535-c591-467f-989f-1cb647c77805 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:16.196148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:16.197104 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:16.197584 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:16.198945 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] PATH_INFO: `/v3/projects/7e106c5a0ce64f04b505c8b439ab45d3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:16.201499 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e106c5a0ce64f04b505c8b439ab45d3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:16.209017 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:16.276624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e106c5a0ce64f04b505c8b439ab45d3', 'request_id': 'req-7f633489-ee39-4700-ab54-d3ab62e58368'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.278473 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:16.286984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e106c5a0ce64f04b505c8b439ab45d3', 'request_id': 'req-7f633489-ee39-4700-ab54-d3ab62e58368'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.298264 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e106c5a0ce64f04b505c8b439ab45d3', 'request_id': 'req-7f633489-ee39-4700-ab54-d3ab62e58368'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.311371 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] The token cache is being invalidate because project 7e106c5a0ce64f04b505c8b439ab45d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:16.311722 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.312389 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.314538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1450/2910] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:16 2022] DELETE /identity/v3/projects/7e106c5a0ce64f04b505c8b439ab45d3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:16.318349 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:16.319800 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:16.332879 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6635be-b4ed-4e9e-b0c6-9d7914f733df admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:16.390838 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:16.391576 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:16.391828 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:16.392098 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] PATH_INFO: `/v3/users/ae17d692596c43009421b7a6e06cfc29` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:16.393224 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae17d692596c43009421b7a6e06cfc29)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:16.395263 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:16.418300 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:16.448360 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae17d692596c43009421b7a6e06cfc29'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.449197 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae17d692596c43009421b7a6e06cfc29'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.460845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae17d692596c43009421b7a6e06cfc29'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.461681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae17d692596c43009421b7a6e06cfc29'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.477485 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae17d692596c43009421b7a6e06cfc29'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.493759 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1461/2911] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:16 2022] DELETE /identity/v3/users/ae17d692596c43009421b7a6e06cfc29 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:16.797899 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:16.799657 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:16.827250 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633489-ee39-4700-ab54-d3ab62e58368 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:16.900692 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:16.901251 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:16.902094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:16.902094 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] PATH_INFO: `/v3/projects/a7b93d911f734aed9ed89b842bf4b766` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:16.902960 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b93d911f734aed9ed89b842bf4b766)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:16.904869 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:16.953552 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b93d911f734aed9ed89b842bf4b766', 'request_id': 'req-7c493910-cccf-4c15-b630-96e57ecd329a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.960839 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b93d911f734aed9ed89b842bf4b766', 'request_id': 'req-7c493910-cccf-4c15-b630-96e57ecd329a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.969127 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b93d911f734aed9ed89b842bf4b766', 'request_id': 'req-7c493910-cccf-4c15-b630-96e57ecd329a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.979764 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] The token cache is being invalidate because project a7b93d911f734aed9ed89b842bf4b766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:16.980053 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.980734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:16.982277 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1451/2912] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:16 2022] DELETE /identity/v3/projects/a7b93d911f734aed9ed89b842bf4b766 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:18.659108 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:18.660642 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:18.723531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5420d-869b-45f0-b13e-0e503b3400ca admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:18.781261 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:18.782194 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:18.782555 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:18.782912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:18.786121 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:18.861345 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:18.862876 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:18.872466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1462/2913] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:25.672464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:25.674090 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:25.687949 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493910-cccf-4c15-b630-96e57ecd329a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:25.693506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:25.694183 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:25.694464 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:25.694741 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] PATH_INFO: `/v3/users/d64a3d12f7ae4c8982bdc54b5853b169` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:25.695889 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64a3d12f7ae4c8982bdc54b5853b169)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:25.697858 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:25.759040 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64a3d12f7ae4c8982bdc54b5853b169'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:25.769694 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64a3d12f7ae4c8982bdc54b5853b169'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:25.770496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64a3d12f7ae4c8982bdc54b5853b169'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:25.777751 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=78,keystone:INSERT=3,keystone:DELETE=19 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:25.784295 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64a3d12f7ae4c8982bdc54b5853b169'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:25.785435 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64a3d12f7ae4c8982bdc54b5853b169'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:25.798756 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1452/2914] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:25 2022] DELETE /identity/v3/users/d64a3d12f7ae4c8982bdc54b5853b169 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:25.991222 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:26.002154 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a5173-40b1-4aca-993c-fa1163cf8e35 service neutron] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:26.006424 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:26.070303 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:26.070948 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:26.071226 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:26.071503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] PATH_INFO: `/v3/projects/54f6126a98384bd189b960708bb4376e` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:26.072738 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f6126a98384bd189b960708bb4376e)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:26.074936 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:26.123961 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f6126a98384bd189b960708bb4376e', 'request_id': 'req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.130348 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f6126a98384bd189b960708bb4376e', 'request_id': 'req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.141671 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f6126a98384bd189b960708bb4376e', 'request_id': 'req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.153103 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] The token cache is being invalidate because project 54f6126a98384bd189b960708bb4376e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:26.153421 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.154112 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.155633 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1463/2915] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:25 2022] DELETE /identity/v3/projects/54f6126a98384bd189b960708bb4376e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:26.160074 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:26.161640 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:26.175625 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393980e-1811-4e61-b76c-8423ca9a55c7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:26.233558 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:26.234282 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:26.234560 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:26.234856 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] PATH_INFO: `/v3/users/7d369d2005144106bd33ca997c4b5324` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:26.236181 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d369d2005144106bd33ca997c4b5324)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:26.238160 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:26.298429 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d369d2005144106bd33ca997c4b5324'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.307112 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d369d2005144106bd33ca997c4b5324'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.307788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d369d2005144106bd33ca997c4b5324'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.320990 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d369d2005144106bd33ca997c4b5324'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.321698 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d369d2005144106bd33ca997c4b5324'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.335073 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1453/2916] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:03:26 2022] DELETE /identity/v3/users/7d369d2005144106bd33ca997c4b5324 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:26.524395 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:26.526802 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:26.548598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3e82-13c0-4a78-bd86-3fdef3bf26d5 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:26.609864 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:26.610505 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:26.610784 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:26.611050 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] PATH_INFO: `/v3/projects/32355a96aa6d44b585a1ab620f6c6463` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:26.612184 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32355a96aa6d44b585a1ab620f6c6463)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:26.614158 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:26.655668 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:26.663312 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32355a96aa6d44b585a1ab620f6c6463', 'request_id': 'req-2b40156e-4039-4540-8b70-a1d1666fd125'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.669476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32355a96aa6d44b585a1ab620f6c6463', 'request_id': 'req-2b40156e-4039-4540-8b70-a1d1666fd125'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.678129 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32355a96aa6d44b585a1ab620f6c6463', 'request_id': 'req-2b40156e-4039-4540-8b70-a1d1666fd125'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.689262 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] The token cache is being invalidate because project 32355a96aa6d44b585a1ab620f6c6463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:03:26.689545 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.690211 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:03:26.691735 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1464/2917] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:03:26 2022] DELETE /identity/v3/projects/32355a96aa6d44b585a1ab620f6c6463 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:03:36.331788 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:36.686071 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.474062 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:13.475514 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:13.536811 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510f8b-3677-4c5a-af11-bb5a092bf7d1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:13.586817 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:13.587446 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:13.587723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:13.587992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:13.589879 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:13.660068 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:13.661586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:13.674259 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1454/2918] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:14.874753 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:14.876290 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:14.889359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40156e-4039-4540-8b70-a1d1666fd125 admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:14.893077 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:14.893681 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:14.893987 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:14.894267 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:14.896174 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:14.917028 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:14.919259 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fcdd0-ea74-4db4-9c77-7afe9982a2c8 service neutron] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:14.933219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1465/2919] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:16.186496 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:16.188217 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:16.207642 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093143c4-dd5f-470b-939c-5fa86eb7f2b1 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:16.215070 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:16.215902 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:16.216734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:16.216734 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:16.218661 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:16.236452 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:16.239443 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:16.253057 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1455/2920] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:17.246927 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] REQUEST_METHOD: `POST` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:17.247436 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:17.247557 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:17.267179 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.auth.core [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] MFA Rules not processed for user `951b4d24f5c4460db22218f94ded0c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81483) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:05:17.268386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:17.324796 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1466/2921] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:05:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:05:17.656991 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:17.669103 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae2f66-1c10-41aa-946b-b6f049d6027a service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:17.673506 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:17.674148 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:17.674422 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:17.674689 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:17.676658 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:17.686590 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:17.688016 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:17.696626 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1456/2922] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:18.214733 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:18.216409 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:18.286799 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04aed2-6193-4157-8f1f-0029b2638410 None None] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:18.292010 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:18.292611 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:18.292884 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:18.293509 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:18.294974 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:18.306625 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:18.308216 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:18.318350 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1467/2923] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:20.480347 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:20.491397 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ad240-8afc-4aec-8485-ac5ac456cfe8 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:20.495393 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:20.496121 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:20.496586 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:20.496984 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:20.503968 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:20.515780 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:20.517243 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f39a59-a0da-40e5-bc13-8a081d28671e service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:20.527632 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1457/2924] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:28.314192 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=63 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:30.523972 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:31.886160 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:31.899463 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74144e6-2e87-4f5a-b585-a9a285bbe832 service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:31.906107 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:31.906766 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:31.907041 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:31.907313 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:31.909090 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:31.922531 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:31.924131 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:31.935256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1468/2925] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:41.930386 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:16.255624 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:07:16.256200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:07:16.256200 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:07:16.276992 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] MFA Rules not processed for user `951b4d24f5c4460db22218f94ded0c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:07:16.278268 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:07:16.286538 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1458/2926] 10.222.0.75 () {58 vars in 958 bytes} [Wed Aug 31 11:07:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:07:17.623155 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:07:17.624829 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:07:17.639519 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea63213-4817-4057-8071-21a3066d5005 service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:07:17.645405 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:07:17.646034 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:07:17.646308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:07:17.646569 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:07:17.648508 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:07:17.660013 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:07:17.661598 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:07:17.671645 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1469/2927] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:07:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:07:26.271003 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:27.667461 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=6 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:32.562442 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:07:32.579617 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e920bc-c190-43e6-b668-3f1915d15315 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:07:32.587134 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:07:32.587738 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:07:32.588011 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:07:32.588273 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:07:32.590417 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:07:32.603616 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:07:32.605234 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:07:32.614215 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1459/2928] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:07:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:07:42.610113 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:23.316437 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:23.331659 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94135c8-1fe5-4f28-9393-c6e887378ebc service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:23.337695 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d48e600b4d470c88bd1606ea51c263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:23.338359 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:23.338640 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:23.338912 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:23.340690 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:09:23.354503 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:23.356274 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:23.368711 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1470/2929] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:09:28.920894 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:28.931076 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2e7c3-5166-4812-8ce6-daed4e22e00d service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:28.934822 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '694756b0eedc408c8796463b541fe5bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:28.935451 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:28.935723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:28.935989 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:28.937792 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:09:29.002710 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:29.004075 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:29.015005 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1460/2930] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:09:32.184479 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:32.201894 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989323c-8f8a-4f70-9e12-7d3dd67220ed service nova] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:32.210269 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:32.210905 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] REQUEST_METHOD: `GET` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:32.211187 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:32.211466 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:32.213219 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:09:32.226594 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:32.228317 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:32.241237 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1471/2931] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:09:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:09:35.479714 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:35.481581 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:09:35.495544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2b272-a5c2-42bd-a828-a3b784b2e1b7 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:35.500831 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:35.501501 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:35.501803 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:35.502165 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] PATH_INFO: `/v3/users/951b4d24f5c4460db22218f94ded0c57` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:35.503297 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=951b4d24f5c4460db22218f94ded0c57)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:35.505247 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:35.554334 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951b4d24f5c4460db22218f94ded0c57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.563884 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951b4d24f5c4460db22218f94ded0c57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.564621 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951b4d24f5c4460db22218f94ded0c57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.576815 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951b4d24f5c4460db22218f94ded0c57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.577513 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951b4d24f5c4460db22218f94ded0c57'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.589723 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1461/2932] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:09:35 2022] DELETE /identity/v3/users/951b4d24f5c4460db22218f94ded0c57 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:09:35.788978 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:35.800486 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c206e47-47d8-41c6-ac73-dad28300bd61 service placement] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:35.876985 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:35.877627 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:35.878017 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:35.878292 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] PATH_INFO: `/v3/projects/fdd5d77d519c46689286cec82a24d9b7` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:35.880256 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd5d77d519c46689286cec82a24d9b7)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:35.882190 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:35.930714 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd5d77d519c46689286cec82a24d9b7', 'request_id': 'req-2b700431-260a-4181-8eee-a3ffe51944aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.937076 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd5d77d519c46689286cec82a24d9b7', 'request_id': 'req-2b700431-260a-4181-8eee-a3ffe51944aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.945308 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd5d77d519c46689286cec82a24d9b7', 'request_id': 'req-2b700431-260a-4181-8eee-a3ffe51944aa'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.956252 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] The token cache is being invalidate because project fdd5d77d519c46689286cec82a24d9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:09:35.956476 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.957110 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:35.958629 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1472/2933] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:09:35 2022] DELETE /identity/v3/projects/fdd5d77d519c46689286cec82a24d9b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:09:35.962857 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:35.964419 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:09:35.978077 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9060e9-7b82-47df-9fbc-cb2c596fcb3e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:36.036246 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:36.036878 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:36.037151 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:36.037416 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] PATH_INFO: `/v3/users/9e6381a9d4ca42b8931ae6e2e5e4b21e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:36.038614 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6381a9d4ca42b8931ae6e2e5e4b21e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:36.040544 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:36.045854 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:36.089085 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6381a9d4ca42b8931ae6e2e5e4b21e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.098158 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6381a9d4ca42b8931ae6e2e5e4b21e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.098823 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6381a9d4ca42b8931ae6e2e5e4b21e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.111120 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6381a9d4ca42b8931ae6e2e5e4b21e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.111827 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6381a9d4ca42b8931ae6e2e5e4b21e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.124779 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1462/2934] 10.222.0.75 () {58 vars in 1224 bytes} [Wed Aug 31 11:09:35 2022] DELETE /identity/v3/users/9e6381a9d4ca42b8931ae6e2e5e4b21e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:09:36.304182 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Authenticating user token {{(pid=81483) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:09:36.305935 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.fernet_utils [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81483) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:09:36.319871 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b700431-260a-4181-8eee-a3ffe51944aa admin admin] Validating token access rules against request {{(pid=81483) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:09:36.381215 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd54da1432894173a79d520df35ac9c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5efb11cead144cc7a5078ee4532b8260', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81483) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:09:36.381873 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:09:36.382149 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:09:36.382415 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] PATH_INFO: `/v3/projects/fe1ba97c0a4f4b44bfce1b5b50aa5c74` {{(pid=81483) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:09:36.383551 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1ba97c0a4f4b44bfce1b5b50aa5c74)` {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:09:36.385586 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] RBAC: Authorization granted {{(pid=81483) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:09:36.391845 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:36.440087 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1ba97c0a4f4b44bfce1b5b50aa5c74', 'request_id': 'req-22d31902-ec80-4137-8f46-8dbce0ffae16'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.446896 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1ba97c0a4f4b44bfce1b5b50aa5c74', 'request_id': 'req-22d31902-ec80-4137-8f46-8dbce0ffae16'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.456040 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1ba97c0a4f4b44bfce1b5b50aa5c74', 'request_id': 'req-22d31902-ec80-4137-8f46-8dbce0ffae16'} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.467725 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] The token cache is being invalidate because project fe1ba97c0a4f4b44bfce1b5b50aa5c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81483) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:09:36.468042 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.468777 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG keystone.notifications [None req-22d31902-ec80-4137-8f46-8dbce0ffae16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81483) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:09:36.470420 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: [pid: 81483|app: 0|req: 1473/2935] 10.222.0.75 () {58 vars in 1233 bytes} [Wed Aug 31 11:09:36 2022] DELETE /identity/v3/projects/fe1ba97c0a4f4b44bfce1b5b50aa5c74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:09:46.121547 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:46.464371 dv-cinder-795785-12-iscsi devstack@keystone.service[81483]: DEBUG dbcounter [-] [81483] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:21.674190 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:21.675844 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:21.826358 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19587d25-57b6-4574-b6eb-a4ab9a2f594a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:21.889564 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e980354e45478d8e78e510db208215', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42bc3b4563aa495480ed7397857e74b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:21.890188 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:21.890462 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:21.890719 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:21.892445 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:21.905028 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:21.906633 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8b98-97b9-4d33-b538-07d2f374cdbf service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:21.917140 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1463/2936] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:31.912636 dv-cinder-795785-12-iscsi devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}